OpenDataLab: Empowering General Artificial Intelligence with Open Datasets

Imagenet: A large-scale hierarchical image database

Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009

Earlier work this paper cites.

Microsoft coco: Common objects in context

Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick · 2014

Earlier work this paper cites.

Hugging face

Hugging Face · 2017

Earlier work this paper cites.

Deep lake

Activeloop · 2018

Earlier work this paper cites.

Papers with code

Meta AI · 2018

Cited alongside, same era.

Conceptual 12m: Pushing web-scale image-text pre-training to recognize long-tail visual concepts

Soravit Changpinyo, Piyush Sharma, Nan Ding, and Radu Soricut · 2021

Cited alongside, same era.

Modelscope

DAMO ACADEMY · 2022

Cited alongside, same era.

Laion-5b: An open large-scale dataset for training next generation image-text models

Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, et al · 2022

Cited alongside, same era.

Wanjuan: A comprehensive multimodal dataset for advancing english and chinese large models

Original

Conghui He, Zhenjiang Jin, Chao Xu, Jiantao Qiu, Bin Wang, Wei Li, Hang Yan, Jiaqi Wang, and Dahua Lin · 2023

Later among the works it cites.

Open assistant

LAION · 2023

Later among the works it cites.

Internvid: A large-scale video-text dataset for multimodal understanding and generation

Original

Yi Wang, Yinan He, Yizhuo Li, Kunchang Li, Jiashuo Yu, Xin Ma, Xinhao Li, Guo Chen, Xinyuan Chen, Yaohui Wang, et al · 2023

Later among the works it cites.

Dsdl: Data set description language for bridging modalities and tasks in ai data

Original

Bin Wang, Linke Ouyang, Fan Wu, Wenchang Ning, Xiao Han, Zhiyuan Zhao, Jiahui Peng, Yiying Jiang, Dahua Lin, and Conghui He · 2024

Closest in time.