Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions

Understand

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly.

• This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following natural language instructions.
• The research community is actively pursuing the development of interactive "embodied agents" that can engage in natural conversations with humans and assist them with real-world tasks.
• These agents must possess the ability to promptly request feedback in case communication breaks down or instructions are unclear.