PREGEN: Uncovering Latent Thoughts in Composed Video Retrieval

Understand

Composed Video Retrieval (CoVR) aims to retrieve a video based on a query video and a modifying text.

• Current CoVR methods fail to fully exploit modern Vision-Language Models (VLMs), either using outdated architectures or requiring computationally expensive fine-tuning and slow caption generation.
• We introduce PREGEN (PRE GENeration extraction), an efficient and powerful CoVR framework that overcomes these limitations.
• Our approach uniquely pairs a frozen, pre-trained VLM with a lightweight encoding model, eliminating the need for any VLM fine-tuning.