Dialog-based Interactive Image Retrieval

Understand

Existing methods for interactive image retrieval have demonstrated the merit of integrating user feedback, improving retrieval results.

• However, most current systems rely on restricted forms of user feedback, such as binary relevance responses, or feedback based on a fixed set of relative attributes, which limits their impact.
• In this paper, we introduce a new approach to interactive image search that enables users to provide feedback via natural language, allowing for more natural and effective interaction.
• We formulate the task of dialog-based interactive image retrieval as a reinforcement learning problem, and reward the dialog system for improving the rank of the target image during each dialog turn.