EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought

Understand

Embodied AI is a crucial frontier in robotics, capable of planning and executing action sequences for robots to accomplish long-horizon tasks in physical environments.

• In this work, we introduce EmbodiedGPT, an end-to-end multi-modal foundation model for embodied AI, empowering embodied agents with multi-modal understanding and execution capabilities.
• To achieve this, we have made the following efforts: (i) We craft a large-scale embodied planning dataset, termed EgoCOT.
• The dataset consists of carefully selected videos from the Ego4D dataset, along with corresponding high-quality language instructions.