DOCCI: Descriptions of Connected and Contrasting Images

Understand

Vision-language datasets are vital for both text-to-image (T2I) and image-to-text (I2T) research.

• However, current datasets lack descriptions with fine-grained detail that would allow for richer associations to be learned by models.
• To fill the gap, we introduce Descriptions of Connected and Contrasting Images (DOCCI), a dataset with long, human-annotated English descriptions for 15k images that were taken, curated and donated by a single researcher intent on capturing key challenges such as spatial relations, counting, text rendering, world knowledge, and more.
• We instruct human annotators to create comprehensive descriptions for each image; these average 136 words in length and are crafted to clearly distinguish each image from those that are related or similar.