Latent Action Pretraining Through World Modeling

Understand

Vision-Language-Action (VLA) models have gained popularity for learning robotic manipulation tasks that follow language instructions.

• State-of-the-art VLAs, such as OpenVLA and $\pi_{0}$, were trained on large-scale, manually labeled action datasets collected through teleoperation.
• More recent approaches, including LAPA and villa-X, introduce latent action representations that enable unsupervised pretraining on unlabeled datasets by modeling abstract visual changes between frames.
• Although these methods have shown strong results, their large model sizes make deployment in real-world settings challenging.