Object Referring in Videos with Language and Human Gaze

Understand

We investigate the problem of object referring (OR) i.e.

• to localize a target object in a visual scene coming with a language description.
• Humans perceive the world more as continued video snippets than as static images, and describe objects not only by their appearance, but also by their spatio-temporal context and motion features.
• Humans also gaze at the object when they issue a referring expression.