Code2World: A GUI World Model via Renderable Code Generation

Understand

Autonomous GUI agents interact with environments by perceiving interfaces and executing actions.

• As a virtual sandbox, the GUI World model empowers agents with human-like foresight by enabling action-conditioned prediction.
• However, existing text- and pixel-based approaches struggle to simultaneously achieve high visual fidelity and fine-grained structural controllability.
• To this end, we propose Code2World, a vision-language coder that simulates the next visual state via renderable code generation.