VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Grounding

Understand

3D visual grounding is crucial for robots, requiring integration of natural language and 3D scene understanding.

• Traditional methods depending on supervised learning with 3D point clouds are limited by scarce datasets.
• Recently zero-shot methods leveraging LLMs have been proposed to address the data issue.
• While effective, these methods only use object-centric information, limiting their ability to handle complex queries.