Awesome-World-Model

A curated list of awesome resources on World Models, based on the comprehensive survey "Understanding World or Predicting Future? A Comprehensive Survey of World Models".

News🔥

• [2024/11/21] Initial release of our survey is available on arXiv.
• [2025/06/13] Our survey paper "Understanding World or Predicting Future? A Comprehensive Survey of World Models" has been accepted by ACM Computing Surveys.
• [2025/06/25] Second version of our survey is available on arXiv.
• [2025/07/18] Initial release of the Awesome-World-Model GitHub repository.

Contact

If you have any suggestions or find our work helpful, feel free to contact us
Email: [email protected]

If this list helps your research, please ⭐ and cite:

@article{ding2025worldmodels,
  title={Understanding World or Predicting Future? A Comprehensive Survey of World Models},
  author={Ding, Jingtao and Zhang, Yunke and Shang, Yu and Zhang, Yuheng and Zong, Zefang and Feng, Jie and Yuan, Yuan and Su, Hongyu and Li, Nian and Sukiennik, Nicholas and Xu, Fengli and Li, Yong},
  journal={ACM Computing Surveys},
  year={2025}
}

Table of Contents 🍃

• 1 Introduction & 2 Background
• 3 Implicit Representation of the External World
  • 3.1 World Model in Decision Making
  • 3.2 World Knowledge Learned by Models
• 4 Future Predictions of the External World
  • 4.1 What to Predict?
  • 4.2 How to Predict?
• 5 Applications of World Models
  • 5.1 World Models for Decision-Making and Control
  • 5.2 World Models for Generative Tasks
  • 5.3 World Models for Embodied Intelligence
• 6 Open Problems and Future Directions
• 7 Conclusion

1 Introduction & 2 Background

Title	Pub. & Date	Code/Project URL
Sora: Creating video from text	OpenAI 2024
A path towards autonomous machine intelligence version 0.9.2, 2022-06-27	Open Review 2022
A framework for representing knowledge	1974
Recurrent world models facilitate policy evolution	2018
World models	2018
Mental models: Towards a cognitive science of language, inference, and consciousness
Sora as an agi world model? a complete survey on text-to-video generation	arXiv 2024
Is sora a world simulator? a comprehensive survey on general world models and beyond	arXiv 2024
World models for autonomous driving: An initial survey	IEEE T-IV 2024
Data-centric evolution in autonomous driving: A comprehensive survey of big data system, data mining, and closed-loop technologies	arXiv 2024
Forging vision foundation models for autonomous driving: Challenges, methodologies, and opportunities	arXiv 2024
From Efficient Multimodal Models to World Models: A Survey	arXiv 2024
MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving	arXiv 2018
YOLOP: You Only Look Once for Panoptic Driving Perception	Image and Vision Computing 2022
Scene transformer: A unified multi-task model for behavior prediction and planning
Motion transformer with global intention localization and local movement refinement	NeurIPS 2022
Query-centric trajectory prediction	CVPR 2023
Gnm: A general navigation model to drive any robot	IEEE Trans. on Robotics 2023
Repvit: Revisiting mobile cnn from vit perspective	CVPR 2024
Learning latent dynamics for planning from pixels	ICML 2019
S3: Social-network Simulation System with Large Language Model-Empowered Agents	arXiv 2023
Generative agents: Interactive simulacra of human behavior	UIST 2023

3 Implicit Representation of the External World

3.1 World Model in Decision Making

Title	Pub. & Date	Code/Project URL
Deep reinforcement learning in a handful of trials using probabilistic dynamics models	NeurIPS 2018
PWM: Policy Learning with Multi-Task World Models	OpenReview
Recurrent world models facilitate policy evolution	NeurIPS 2018
Dream to control: Learning behaviors by latent imagination	arXiv 2019
Leveraging pre-trained large language models to construct and utilize world models for model-based task planning	NeurIPS 2023
Mastering atari with discrete world models	arXiv 2020
Mastering diverse control tasks through world models	Nature 2024
TD-MPC2: Scalable, Robust World Models for Continuous Control	OpenReview
When to trust your model: Model-based policy optimization	NeurIPS 2019
Offline reinforcement learning as one big sequence modeling problem	NeurIPS 2021
Model predictive control	Springer
Algorithmic framework for model-based deep reinforcement learning with theoretical guarantees	arXiv 2018
Neural network dynamics for model-based deep reinforcement learning with model-free fine-tuning	IEEE 2018
A game theoretic framework for model based reinforcement learning	PMLR 2020
General agents need world models	arXiv 2025
Mastering memory tasks with world models	arXiv 2024
A generalist dynamics model for control	arXiv 2023
Exploring model-based planning with policy networks	arXiv 2019
Derivative-free optimization via classification	AAAI
Mastering the game of Go with deep neural networks and tree search	Nature 2016
Mastering the game of go without human knowledge	Nature 2017
A0c: Alpha zero in continuous action space	arXiv 2018
Value prediction network	NeurIPS 2017
Probabilistic adaptation of text-to-video models	arXiv 2023
RoboDreamer: Learning Compositional World Models for Robot Imagination	arXiv 2024
Discuss before moving: Visual language navigation via multi-expert discussions	IEEE 2024
OVER-NAV: Elevating Iterative Vision-and-Language Navigation with Open-Vocabulary Detection and Structured Representation	CVPR 2024
RILA: Reflective and Imaginative Language Agent for Zero-Shot Semantic Audio-Visual Navigation	CVPR 2024
Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Models	arXiv 2025
Position: LLMs can't plan, but can help planning in LLM-modulo frameworks	arXiv 2024
Language models meet world models: Embodied experiences enhance language models	NeurIPS 2023
Virtualhome: Simulating household activities via programs	CVPR 2018
Learning to Model the World with Language	arXiv 2023
Reason for Future, Act for Now: A Principled Framework for Autonomous LLM Agents with Provable Sample Efficiency	arXiv 2023
Alfworld: Aligning text and embodied environments for interactive learning	OpenReview