iMOVE: Instance-Motion-Aware Video Understanding

Understand

Enhancing the fine-grained instance spatiotemporal motion perception capabilities of Video Large Language Models is crucial for improving their temporal and general video understanding.

• However, current models struggle to perceive detailed and complex instance motions.
• To address these challenges, we have made improvements from both data and model perspectives.
• In terms of data, we have meticulously curated iMOVE-IT, the first large-scale instance-motion-aware video instruction-tuning dataset.