Hey Robot! Personalizing Robot Navigation through Model Predictive Control with a Large Language Model

Understand

Robot navigation methods allow mobile robots to operate in applications such as warehouses or hospitals.

• While the environment in which the robot operates imposes requirements on its navigation behavior, most existing methods do not allow the end-user to configure the robot's behavior and priorities, possibly leading to undesirable behavior (e.g., fast driving in a hospital).
• We propose a novel approach to adapt robot motion behavior based on natural language instructions provided by the end-user.
• Our zero-shot method uses an existing Visual Language Model to interpret a user text query or an image of the environment.