InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language

Understand

We present an interactive visual framework named InternGPT, or iGPT for short.

• The framework integrates chatbots that have planning and reasoning capabilities, such as ChatGPT, with non-verbal instructions like pointing movements that enable users to directly manipulate images or videos on the screen.
• Pointing (including gestures, cursors, etc.) movements can provide more flexibility and precision in performing vision-centric tasks that require fine-grained control, editing, and generation of visual content.
• The name InternGPT stands for \textbf{inter}action, \textbf{n}onverbal, and \textbf{chat}bots.