Do large language vision models understand 3D shapes?

Understand

Large vision language models (LVLM) are the leading A.I approach for achieving a general visual understanding of the world.

• Models such as GPT, Claude, Gemini, and LLama can use images to understand and analyze complex visual scenes.
• 3D objects and shapes are the basic building blocks of the world, recognizing them is a fundamental part of human perception.
• The goal of this work is to test whether LVLMs truly understand 3D shapes by testing the models ability to identify and match objects of the exact same 3D shapes but with different orientations and materials/textures.