Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Tasks

Understand

We present Bloom Library, a linguistically diverse set of multimodal and multilingual datasets for language modeling, image captioning, visual storytelling, and speech synthesis/recognition.

• These datasets represent either the most, or among the most, multilingual datasets for each of the included downstream tasks.
• In total, the initial release of the Bloom Library datasets covers 363 languages across 32 language families.
• We train downstream task models for various languages represented in the data, showing the viability of the data for future work in low-resource, multimodal NLP and establishing the first known baselines for these downstream tasks in certain languages (e.g., Bisu [bzi], with an estimated population of 700 users).