Fetching the paper…
Reading the bibliography…
We propose the Metropolis-Hastings Captioning Game (MHCG), a method to fuse knowledge of multiple vision-language models (VLMs) by learning from each other.
Probvlm: Probabilistic adapter for frozen vison-language models
Uddeshya Upadhyay, Shyamgopal Karthik, Massimiliano Mancini, and Zeynep Akata. 2023 · 1910
Earlier work this paper cites.
Catastrophic interference in connectionist networks: The sequential learning problem
Michael McCloskey and Neal J Cohen. 1989 · 1989
Earlier work this paper cites.
Grammatical acquisition: Inductive bias and coevolution of language and the language acquisition device
Ted Briscoe. 2000 · 2000
Earlier work this paper cites.
Spontaneous evolution of linguistic structure-an iterated learning model of the emergence of regularity and irregularity
Simon. Kirby. 2001 · 2001
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
Emergent multi-agent communication in the deep learning era
Angeliki Lazaridou and Marco Baroni. 2020 · 2006
Earlier work this paper cites.
Meteor: An automatic metric for mt evaluation with high levels of correlation with human judgments
Alon Lavie and Abhaya Agarwal. 2007 · 2007
Earlier work this paper cites.
A Perceptual System for Language Game Experiments . Springer US, Boston, MA
Michael Spranger, Martin Loetzsch, and Luc Steels. 2012 · 2012
Earlier work this paper cites.
Microsoft coco: Common objects in context
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014 · 2014
Earlier work this paper cites.
The Talking Heads experiment
Luc L. Steels. 2015 · 2015
Earlier work this paper cites.
Learning to communicate with deep multi-agent reinforcement learning
Jakob N. Foerster, Yannis M. Assael, Nando de Freitas, and Shimon Whiteson. 2016 · 2016
Earlier work this paper cites.
Emergence of language with multi-agent games: Learning to communicate with sequences of symbols
Serhii Havrylov and Ivan Titov. 2017 · 2017
Earlier work this paper cites.
Snapshot ensembles: Train 1, get m for free
Gao Huang, Yixuan Li, Geoff Pleiss, Zhuang Liu, John E. Hopcroft, and Kilian Q. Weinberger. 2017 · 2017
Earlier work this paper cites.
Natural language does not emerge ’naturally’ in multi-agent dialog
Satwik Kottur, José M. F. Moura, Stefan Lee, and Dhruv Batra. 2017 · 2017
Earlier work this paper cites.
Multi-agent cooperation and the emergence of (natural) language
Angeliki Lazaridou, Alexander Peysakhovich, and Marco Baroni. 2017 · 2017
Earlier work this paper cites.
Conceptual captions: A cleaned, hypernymed, image alt-text dataset for automatic image captioning
Piyush Sharma, Nan Ding, Sebastian Goodman, and Radu Soricut. 2018 · 2018
Earlier work this paper cites.
Anti-efficient encoding in emergent communication
Rahma Chaabouni, Eugene Kharitonov, Emmanuel Dupoux, and Marco Baroni. 2019 · 2019
Earlier work this paper cites.
Visual attention in multi-label image classification
Yan Luo, Ming Jiang, and Qi Zhao. 2019 · 2019
Earlier work this paper cites.
Sentence-bert: Sentence embeddings using siamese bert-networks
Nils Reimers and Iryna Gurevych. 2019 · 2019
Cited alongside, same era.
Dark experience for general continual learning: a strong, simple baseline
Pietro Buzzega, Matteo Boschini, Angelo Porrello, Davide Abati, and Simone Calderara. 2020 · 2020
Cited alongside, same era.
Compositionality and generalization in emergent languages
Rahma Chaabouni, Eugene Kharitonov, Diane Bouchacourt, Emmanuel Dupoux, and Marco Baroni. 2020 · 2020
Cited alongside, same era.
Federated learning with matched averaging
Hongyi Wang, Mikhail Yurochkin, Yuekai Sun, Dimitris Papailiopoulos, and Yasaman Khazaeni. 2020 · 2020
Cited alongside, same era.
Bertscore: Evaluating text generation with bert
Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2020 · 2020
Cited alongside, same era.
Clipscore: A reference-free evaluation metric for image captioning
Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, and Yejin Choi. 2021 · 2021
Recursive metropolis-hastings naming game: symbol emergence in a multi-agent system based on probabilistic generative models
Jun Inukai, Tadahiro Taniguchi, Akira Taniguchi, and Yoshinobu Hagiwara. 2023 · 2023
Later among the works it cites.
Llm-blender: Ensembling large language models with pairwise ranking and generative fusion
Dongfu Jiang, Xiang Ren, and Bill Yuchen Lin. 2023 · 2023
Later among the works it cites.
Weishi Li, Yong Peng, Miao Zhang, Liang Ding, Han Hu, and Li Shen. 2023 · 2023
Later among the works it cites.
Referential communication in heterogeneous communities of pre-trained visual deep networks
Mateo Mahaut, Francesca Franzon, Roberto Dessì, and Marco Baroni. 2023 · 2023
Later among the works it cites.
Positive-augmented contrastive learning for image and video captioning evaluation
Sara Sarto, Manuele Barraco, Marcella Cornia, Lorenzo Baraldi, and Rita Cucchiara. 2023 · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Lora: Low-rank adaptation of large language models
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021
Cited alongside, same era.
Clipcap: Clip prefix for image captioning
Ron Mokady, Amir Hertz, and Amit H Bermano. 2021 · 2021
Cited alongside, same era.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021 · 2021
Cited alongside, same era.
Wit: Wikipedia-based image text dataset for multimodal multilingual machine learning
Krishna Srinivasan, Karthik Raman, Jiecao Chen, Michael Bendersky, and Marc Najork. 2021 · 2021
Cited alongside, same era.
Flamingo: a visual language model for few-shot learning
Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, et al. 2022 · 2022
Cited alongside, same era.
Emergent language-based coordination in deep multi-agent systems
Marco Baroni, Roberto Dessi, and Angeliki Lazaridou. 2022 · 2022
Cited alongside, same era.
Later among the works it cites.
Emergent communication through metropolis-hastings naming game with deep generative models
Tadahiro Taniguchi, Yuto Yoshida, Yuta Matsui, Nguyen Le Hoang, Akira Taniguchi, and Yoshinobu Hagiwara. 2023 · 2023
Later among the works it cites.
Baby llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty
Inar Timiryasov and Jean-Loup Tastet. 2023 · 2023
Later among the works it cites.
On the word boundaries of emergent languages based on harris’s articulation scheme
Ryo Ueda, Taiga Ishii, and Yusuke Miyao. 2023 · 2023
Later among the works it cites.
A review of the applications of deep learning-based emergent communication
Brendon Boldt and David R Mortensen. 2024 · 2024
Later among the works it cites.
Knowledge fusion by evolving weights of language models
Guodong Du, Jing Li, Hanting Liu, Runhua Jiang, Shuyang Yu, Yifei Guo, Sim Kuan Goh, and Ho-Kin Tang. 2024 · 2024
Later among the works it cites.
Compositionality and generalization in emergent communication using metropolis-hastings naming game
Nguyen Le Hoang, Yuta Matsui, Yoshinobu Hagiwara, Akira Taniguchi, and Tadahiro Taniguchi. 2024 · 2024
Later among the works it cites.
Pack of llms: Model fusion at test-time via perplexity optimization
Costas Mavromatis, Petros Karypis, and George Karypis. 2024 · 2024
Later among the works it cites.
Aloha: A new measure for hallucination in captioning models
Suzanne Petryk, David Chan, Anish Kachinthaya, Haodi Zou, John Canny, Joseph Gonzalez, and Trevor Darrell. 2024 · 2024
Later among the works it cites.
Language evolution with deep learning
Mathieu Rita, Paul Michel, Rahma Chaabouni, Olivier Pietquin, Emmanuel Dupoux, and Florian Strub. 2024 · 2024
Later among the works it cites.
Collective predictive coding hypothesis: Symbol emergence as decentralized bayesian inference
Tadahiro Taniguchi. 2024 · 2024
Later among the works it cites.
Adamerging: Adaptive model merging for multi-task learning
Enneng Yang, Zhenyi Wang, Li Shen, Shiwei Liu, Guibing Guo, Xingwei Wang, and Dacheng Tao. 2024 · 2024
Later among the works it cites.
Evolutionary optimization of model merging recipes
Takuya Akiba, Makoto Shing, Yujin Tang, Qi Sun, and David Ha. 2025 · 2025
Closest in time.