Enhance Image-to-Image Generation with LLaVA-generated Prompts

Understand

This paper presents a novel approach to enhance image-to-image generation by leveraging the multimodal capabilities of the Large Language and Vision Assistant (LLaVA).

• We propose a framework where LLaVA analyzes input images and generates textual descriptions, hereinafter LLaVA-generated prompts.
• These prompts, along with the original image, are fed into the image-to-image generation pipeline.
• This enriched representation guides the generation process towards outputs that exhibit a stronger resemblance to the input image.