Sora as a World Model? A Complete Survey on Text-to-Video Generation

Understand

The evolution of video generation from text, from animating MNIST to simulating the world with Sora, has progressed at a breakneck speed.

• Here, we systematically discuss how far text-to-video generation technology supports essential requirements in world modeling.
• We curate 250+ studies on text-based video synthesis and world modeling.
• We then observe that recent models increasingly support spatial, action, and strategic intelligences in world modeling through adherence to completeness, consistency, invention, as well as human interaction and control.