Concept-skill Transferability-based Data Selection for Large Vision-Language Models

The information complexity of learning tasks, their structure and their distance

Alessandro Achille, Giovanni Paolini, Glen Mbeng, and Stefano Soatto. 2020 · 1904

Earlier work this paper cites.

Submodularity in data subset selection and active learning

Kai Wei, Rishabh K. Iyer, and Jeff A. Bilmes. 2015 · 2015

Earlier work this paper cites.

Examples are not enough, learn to criticize! criticism for interpretability

Been Kim, Oluwasanmi Koyejo, and Rajiv Khanna. 2016 · 2016

Earlier work this paper cites.

Making the V in VQA matter: Elevating the role of image understanding in visual question answering

Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, and Devi Parikh. 2017 · 2017

Earlier work this paper cites.

Aligned image-word representations improve inductive transfer across vision-language tasks

Tanmay Gupta, Kevin Shih, Saurabh Singh, and Derek Hoiem. 2017 · 2017

Earlier work this paper cites.

icarl: Incremental classifier and representation learning

Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H. Lampert. 2017 · 2017

Earlier work this paper cites.

Vizwiz grand challenge: Answering visual questions from blind people

Danna Gurari, Qing Li, Abigale J. Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, and Jeffrey P. Bigham. 2018 · 2018

Earlier work this paper cites.

Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (TCAV)

Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, and Rory sayres. 2018 · 2018

Earlier work this paper cites.

Active learning for convolutional neural networks: A core-set approach

Ozan Sener and Silvio Savarese. 2018 · 2018

Earlier work this paper cites.

Taskonomy: Disentangling task transfer learning

Amir R. Zamir, Alexander Sax, William Shen, Leonidas J. Guibas, Jitendra Malik, and Silvio Savarese. 2018 · 2018

Earlier work this paper cites.

Gradient based sample selection for online continual learning

Rahaf Aljundi, Min Lin, Baptiste Goujaud, and Yoshua Bengio. 2019 · 2019

Earlier work this paper cites.

GQA: A new dataset for real-world visual reasoning and compositional question answering

Drew A. Hudson and Christopher D. Manning. 2019 · 2019

Earlier work this paper cites.

Towards VQA models that can read

Amanpreet Singh, Vivek Natarajan, Meet Shah, Yu Jiang, Xinlei Chen, Dhruv Batra, Devi Parikh, and Marcus Rohrbach. 2019 · 2019

Earlier work this paper cites.

Emergent linguistic structure in artificial neural networks trained by self-supervision

Christopher D. Manning, Kevin Clark, John Hewitt, Urvashi Khandelwal, and Omer Levy. 2020 · 2020

Earlier work this paper cites.

Identifying mislabeled data using the area under the margin ranking

Geoff Pleiss, Tianyi Zhang, Ethan R. Elenberg, and Kilian Q. Weinberger. 2020 · 2020

Earlier work this paper cites.

Generic attention-model explainability for interpreting bi-modal and encoder-decoder transformers

Hila Chefer, Shir Gur, and Lior Wolf. 2021 · 2021

Earlier work this paper cites.

Deep learning on a data diet: Finding important examples early in training

Mansheej Paul, Surya Ganguli, and Gintare Karolina Dziugaite. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021 · 2021

Earlier work this paper cites.

Flamingo: a visual language model for few-shot learning

Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katie Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda Han, Zhitao Gong, Sina Samangooei, Marianne Monteiro, Jacob Menick, Sebastian Borgeaud, Andrew Brock, Aida Nematzadeh, Sahand Sharifzadeh, Mikolaj Binkowski, Ricardo Barreira, Oriol Vinyals, Andrew Zisserman, and Karen Simonyan. 2022 · 2022

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022 · 2022

Cited alongside, same era.

Learn to explain: Multimodal reasoning via thought chains for science question answering

Pan Lu, Swaroop Mishra, Tanglin Xia, Liang Qiu, Kai-Wei Chang, Song-Chun Zhu, Oyvind Tafjord, Peter Clark, and Ashwin Kalyan. 2022 · 2022

Cited alongside, same era.

Introducing chatgpt

OpenAI. 2022 · 2022

Cited alongside, same era.

Beyond neural scaling laws: beating power law scaling via data pruning

Ben Sorscher, Robert Geirhos, Shashank Shekhar, Surya Ganguli, and Ari Morcos. 2022 · 2022

Cited alongside, same era.

Semdedup: Data-efficient learning at web-scale through semantic deduplication

Original

Amro Abbas, Kushal Tirumala, Daniel Simig, Surya Ganguli, and Ari S. Morcos. 2023 · 2023

Cited alongside, same era.

Mm-vet: Evaluating large multimodal models for integrated capabilities

Original

Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, and Lijuan Wang. 2023 · 2023

Later among the works it cites.

Sigmoid loss for language image pre-training

Xiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, and Lucas Beyer. 2023 · 2023

Later among the works it cites.

LIMA: less is more for alignment

Chunting Zhou, Pengfei Liu, Puxin Xu, Srinivasan Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, and Omer Levy. 2023 · 2023

Later among the works it cites.

Minigpt-4: Enhancing vision-language understanding with advanced large language models

Original

Deyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li, and Mohamed Elhoseiny. 2023 · 2023

Later among the works it cites.

Internlm-xcomposer2-4khd: A pioneering large vision-language model handling resolutions from 336 pixels to 4k hd

Original