Multi3DRefer: Grounding Text Description to Multiple 3D Objects

Understand

We introduce the task of localizing a flexible number of objects in real-world 3D scenes using natural language descriptions.

• Existing 3D visual grounding tasks focus on localizing a unique object given a text description.
• However, such a strict setting is unnatural as localizing potentially multiple objects is a common need in real-world scenarios and robotic tasks (e.g., visual navigation and object rearrangement).
• To address this setting we propose Multi3DRefer, generalizing the ScanRefer dataset and task.