Yume-1.5: A Text-Controlled Interactive World Generation Model

Understand

Recent approaches have demonstrated the promise of using diffusion models to generate interactive and explorable worlds.

• However, most of these methods face critical challenges such as excessively large parameter sizes, reliance on lengthy inference steps, and rapidly growing historical context, which severely limit real-time performance and lack text-controlled generation capabilities.
• To address these challenges, we propose \method, a novel framework designed to generate realistic, interactive, and continuous worlds from a single image or text prompt.
• \method achieves this through a carefully designed framework that supports keyboard-based exploration of the generated worlds.