DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving

Understand

World models, especially in autonomous driving, are trending and drawing extensive attention due to their capacity for comprehending driving environments.

• The established world model holds immense potential for the generation of high-quality driving videos, and driving policies for safe maneuvering.
• However, a critical limitation in relevant research lies in its predominant focus on gaming environments or simulated settings, thereby lacking the representation of real-world driving scenarios.
• Therefore, we introduce DriveDreamer, a pioneering world model entirely derived from real-world driving scenarios.