Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation

Continual learning with tiny episodic memories

Original

Arslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny, Thalaiyasingam Ajanthan, Puneet Kumar Dokania, Philip H. S. Torr, and Marc’Aurelio Ranzato. 2019 · 1902

Earlier work this paper cites.

Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks

Original

Jiasen Lu, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019 · 1908

Earlier work this paper cites.

Lxmert: Learning cross-modality encoder representations from transformers

Original

Hao Tan and Mohit Bansal. 2019 · 1908

Earlier work this paper cites.

Contcap: A scalable framework for continual image captioning

Original

Giang Nguyen, Tae Joon Jun, Trung Tran, Tolcha Yalew, and Daeyoung Kim. 2019 · 1909

Earlier work this paper cites.

Catastrophic interference in connectionist networks: The sequential learning problem

Michael McCloskey and Neal J Cohen. 1989 · 1989

Earlier work this paper cites.

Connectionist models of recognition memory: constraints imposed by learning and forgetting functions

Roger Ratcliff. 1990 · 1990

Earlier work this paper cites.

icarl: Incremental classifier and representation learning

Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H Lampert. 2017 · 2010

Earlier work this paper cites.

Im2text: Describing images using 1 million captioned photographs

Vicente Ordonez, Girish Kulkarni, and Tamara Berg. 2011 · 2011

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik P Kingma and Jimmy Ba. 2014 · 2014

Earlier work this paper cites.

Microsoft coco: Common objects in context

Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014 · 2014

Earlier work this paper cites.

Pathnet: Evolution channels gradient descent in super neural networks

Original

Chrisantha Fernando, Dylan Banarse, Charles Blundell, Yori Zwols, David Ha, Andrei A. Rusu, Alexander Pritzel, and Daan Wierstra. 2017 · 2017

Earlier work this paper cites.

Making the v in vqa matter: Elevating the role of image understanding in visual question answering

Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, and Devi Parikh. 2017 · 2017

Earlier work this paper cites.

Overcoming catastrophic forgetting in neural networks

James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. 2017 · 2017

Earlier work this paper cites.

Visual genome: Connecting language and vision using crowdsourced dense image annotations

Ranjay Krishna, Yuke Zhu, Oliver Groth, Justin Johnson, Kenji Hata, Joshua Kravitz, Stephanie Chen, Yannis Kalantidis, Li-Jia Li, David A Shamma, et al. 2017 · 2017

Earlier work this paper cites.

Core50: a new dataset and benchmark for continuous object recognition

Vincenzo Lomonaco and Davide Maltoni. 2017 · 2017

Earlier work this paper cites.

Continual learning through synaptic intelligence

Friedemann Zenke, Ben Poole, and Surya Ganguli. 2017 · 2017

Earlier work this paper cites.

Memory aware synapses: Learning what (not) to forget

Rahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny, Marcus Rohrbach, and Tinne Tuytelaars. 2018 · 2018

Earlier work this paper cites.

Bottom-up and top-down attention for image captioning and visual question answering

Peter Anderson, Xiaodong He, Chris Buehler, Damien Teney, Mark Johnson, Stephen Gould, and Lei Zhang. 2018 · 2018

Earlier work this paper cites.

Learning without forgetting

Zhizhong Li and Derek Hoiem. 2018 · 2018

Earlier work this paper cites.

Overcoming catastrophic forgetting with hard attention to the task

Joan Serrà, Didac Suris, Marius Miron, and Alexandros Karatzoglou. 2018 · 2018

Earlier work this paper cites.

Conceptual captions: A cleaned, hypernymed, image alt-text dataset for automatic image captioning

Piyush Sharma, Nan Ding, Sebastian Goodman, and Radu Soricut. 2018 · 2018

Earlier work this paper cites.

Generative replay with feedback connections as a general strategy for continual learning

Original

Gido M Van de Ven and Andreas S Tolias. 2018 · 2018

Earlier work this paper cites.

Learning without memorizing

Prithviraj Dhar, Rajat Vikram Singh, Kuan-Chuan Peng, Ziyan Wu, and Rama Chellappa. 2019 · 2019

Earlier work this paper cites.

Psycholinguistics meets continual learning: Measuring catastrophic forgetting in visual question answering

Claudio Greco, Barbara Plank, Raquel Fernández, and Raffaella Bernardi. 2019 · 2019

Earlier work this paper cites.

Learning a unified classifier incrementally via rebalancing

Saihui Hou, Xinyu Pan, Chen Change Loy, Zilei Wang, and Dahua Lin. 2019 · 2019

Earlier work this paper cites.

Gqa: A new dataset for real-world visual reasoning and compositional question answering

Drew A Hudson and Christopher D Manning. 2019 · 2019

Cited alongside, same era.

Similarity of neural network representations revisited

Simon Kornblith, Mohammad Norouzi, Honglak Lee, and Geoffrey Hinton. 2019 · 2019

Cited alongside, same era.

Lamol: Language modeling for lifelong language learning

Fan-Keng Sun, Cheng-Hao Ho, and Hung yi Lee. 2019 · 2019

Cited alongside, same era.

Large scale incremental learning

Yue Wu, Yinpeng Chen, Lijuan Wang, Yuancheng Ye, Zicheng Liu, Yandong Guo, and Yun Fu. 2019 · 2019

Cited alongside, same era.

Dark experience for general continual learning: a strong, simple baseline

Pietro Buzzega, Matteo Boschini, Angelo Porrello, Davide Abati, and Simone Calderara. 2020 · 2020

Cited alongside, same era.

Uniter: Universal image-text representation learning

Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu. 2020 · 2020

Continual learning with foundation models: An empirical study of latent replay

Oleksiy Ostapenko, Timothee Lesort, Pau Rodríguez, Md Rifat Arefin, Arthur Douillard, Irina Rish, and Laurent Charlin. 2022 · 2022

Later among the works it cites.

Effect of scale on catastrophic forgetting in neural networks

Vinay Venkatesh Ramasesh, Aitor Lewkowycz, and Ethan Dyer. 2022 · 2022

Later among the works it cites.

Climb: A continual learning benchmark for vision-and-language tasks

Tejas Srinivasan, Ting-Yun Chang, Leticia Pinto Alva, Georgios Chochlakis, Mohammad Rostami, and Jesse Thomason. 2022 · 2022

Later among the works it cites.

Continual learning through retrieval and imagination

Zhen Wang, Liu Liu, Yiqun Duan, and Dacheng Tao. 2022 · 2022

Later among the works it cites.

Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks

Nan Wu, Stanislaw Jastrzebski, Kyunghyun Cho, and Krzysztof J Geras. 2022 · 2022

Later among the works it cites.