MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMs

Pairwise preference learning and ranking

Johannes Fürnkranz and Eyke Hüllermeier · 2003

Earlier work this paper cites.

Ordinal regression by extended binary classification

Ling Li and Hsuan-Tien Lin · 2006

Earlier work this paper cites.

Learning to rank: from pairwise approach to listwise approach

Zhe Cao, Tao Qin, Tie-Yan Liu, Ming-Feng Tsai, and Hang Li · 2007

Earlier work this paper cites.

Imagenet: A large-scale hierarchical image database

Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009

Earlier work this paper cites.

Learning to rank for information retrieval

Tie-Yan Liu et al · 2009

Earlier work this paper cites.

Ordinal hyperplanes ranker with cost sensitivities for age estimation

Kuang-Yu Chang, Chu-Song Chen, and Yi-Ping Hung · 2011

Earlier work this paper cites.

Relative attributes

Devi Parikh and Kristen Grauman · 2011

Earlier work this paper cites.

The caltech-ucsd birds-200-2011 dataset

Catherine Wah, Steve Branson, Peter Welinder, Pietro Perona, and Serge Belongie · 2011

Earlier work this paper cites.

Indoor segmentation and support inference from rgbd images

Nathan Silberman, Derek Hoiem, Pushmeet Kohli, and Rob Fergus · 2012

Earlier work this paper cites.

Challenges in representation learning: A report on three machine learning contests

Ian J Goodfellow, Dumitru Erhan, Pierre Luc Carrier, Aaron Courville, Mehdi Mirza, Ben Hamner, Will Cukierski, Yichuan Tang, David Thaler, Dong-Hyun Lee, et al · 2013

Earlier work this paper cites.

Microsoft coco captions: Data collection and evaluation server

Original

Xinlei Chen, Hao Fang, Tsung-Yi Lin, Ramakrishna Vedantam, Saurabh Gupta, Piotr Dollár, and C Lawrence Zitnick · 2015

Earlier work this paper cites.

Discovering states and transformations in image collections

Phillip Isola, Joseph J Lim, and Edward H Adelson · 2015

Earlier work this paper cites.

Large-scale celebfaces attributes (celeba) dataset

Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang · 2015

Earlier work this paper cites.

A large-scale car dataset for fine-grained categorization and verification

Linjie Yang, Ping Luo, Chen Change Loy, and Xiaoou Tang · 2015

Earlier work this paper cites.

The cityscapes dataset for semantic urban scene understanding

Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele · 2016

Earlier work this paper cites.

Ordinal regression with multiple output cnn for age estimation

Zhenxing Niu, Mo Zhou, Le Wang, Xinbo Gao, and Gang Hua · 2016

Earlier work this paper cites.

Deep reinforcement learning from human preferences

Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei · 2017

Earlier work this paper cites.

Making the v in vqa matter: Elevating the role of image understanding in visual question answering

Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, and Devi Parikh · 2017

Earlier work this paper cites.

Soccernet: A scalable dataset for action spotting in soccer videos

Silvio Giancola, Mohieddine Amine, Tarek Dghaily, and Bernard Ghanem · 2018

Earlier work this paper cites.

Learning to describe differences between pairs of similar images

Harsh Jhamtani and Taylor Berg-Kirkpatrick · 2018

Earlier work this paper cites.

Towards automatic learning of procedures from web instructional videos

Luowei Zhou, Chenliang Xu, and Jason Corso · 2018

Earlier work this paper cites.

Nocaps: Novel object captioning at scale

Harsh Agrawal, Karan Desai, Yufei Wang, Xinlei Chen, Rishabh Jain, Mark Johnson, Dhruv Batra, Devi Parikh, Stefan Lee, and Peter Anderson · 2019

Earlier work this paper cites.

Neural naturalist: Generating fine-grained image comparisons

Maxwell Forbes, Christine Kaeser-Chen, Piyush Sharma, and Serge Belongie · 2019

Earlier work this paper cites.

Gqa: A new dataset for real-world visual reasoning and compositional question answering

Drew A Hudson and Christopher D Manning · 2019

Earlier work this paper cites.

Sports video captioning via attentive motion representation and group relationship modeling

Mengshi Qi, Yunhong Wang, Annan Li, and Jiebo Luo · 2019

Cited alongside, same era.

Towards vqa models that can read

Amanpreet Singh, Vivek Natarjan, Meet Shah, Yu Jiang, Xinlei Chen, Devi Parikh, and Marcus Rohrbach · 2019

Cited alongside, same era.

A corpus for reasoning about natural language grounded in photographs

Alane Suhr, Stephanie Zhou, Ally Zhang, Iris Zhang, Huajun Bai, and Yoav Artzi · 2019

Cited alongside, same era.

Uniter: Universal image-text representation learning

Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu · 2020

Cited alongside, same era.

Fashionpedia: Ontology, segmentation, and an attribute localization dataset

Menglin Jia, Mengyun Shi, Mikhail Sirotenko, Yin Cui, Claire Cardie, Bharath Hariharan, Hartwig Adam, and Serge Belongie · 2020

Cited alongside, same era.

Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models

Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi · 2023

Later among the works it cites.

Teaching clip to count to ten

Roni Paiss, Ariel Ephrat, Omer Tov, Shiran Zada, Inbar Mosseri, Michal Irani, and Tali Dekel · 2023

Later among the works it cites.

Kosmos-2: Grounding multimodal large language models to the world

Original

Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, and Furu Wei · 2023

Later among the works it cites.

Combined scaling for zero-shot transfer learning

Hieu Pham, Zihang Dai, Golnaz Ghiasi, Kenji Kawaguchi, Hanxiao Liu, Adams Wei Yu, Jiahui Yu, Yi-Ting Chen, Minh-Thang Luong, Yonghui Wu, et al · 2023

Later among the works it cites.

Gemini: a family of highly capable multimodal models

Original

Gemini Team, Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, et al · 2023