FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model

Bleu: a method for automatic evaluation of machine translation

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

ROUGE: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

METEOR: An automatic metric for MT evaluation with improved correlation with human judgments

Satanjeev Banerjee and Alon Lavie. 2005 · 2005

Earlier work this paper cites.

Framing image description as a ranking task: Data, models and evaluation metrics

Micah Hodosh, Peter Young, and Julia Hockenmaier. 2013 · 2013

Earlier work this paper cites.

Microsoft coco: Common objects in context

Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014 · 2014

Earlier work this paper cites.

From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions

Peter Young, Alice Lai, Micah Hodosh, and Julia Hockenmaier. 2014 · 2014

Earlier work this paper cites.

Bertscore: Evaluating text generation with bert

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020 · 2014

Earlier work this paper cites.

From images to sentences through scene description graphs using commonsense reasoning and knowledge

Original

Somak Aditya, Yezhou Yang, Chitta Baral, Cornelia Fermuller, and Yiannis Aloimonos. 2015 · 2015

Earlier work this paper cites.

Cider: Consensus-based image description evaluation

R. Vedantam, C. Zitnick, and D. Parikh. 2015 · 2015

Earlier work this paper cites.

Spice: Semantic propositional image caption evaluation

Peter Anderson, Basura Fernando, Mark Johnson, and Stephen Gould. 2016 · 2016

Earlier work this paper cites.

FOIL it! find one mismatch between image and language caption

Ravi Shekhar, Sandro Pezzelle, Yauhen Klimovich, Aurélie Herbelot, Moin Nabi, Enver Sangineto, and Raffaella Bernardi. 2017 · 2017

Earlier work this paper cites.

TIGEr: Text-to-image grounding for image caption evaluation

Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, and Jianfeng Gao. 2019 · 2019

Cited alongside, same era.

ViLBERTScore: Evaluating image caption using vision-and-language BERT

Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, and Kyomin Jung. 2020 · 2020

Cited alongside, same era.

CLIPScore: A reference-free evaluation metric for image captioning

Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, and Yejin Choi. 2021 · 2021

Cited alongside, same era.

COSMic: A coherence-aware generation metric for image descriptions

Mert Inan, Piyush Sharma, Baber Khalid, Radu Soricut, Matthew Stone, and Malihe Alikhani. 2021 · 2021

Cited alongside, same era.

Clipcap: Clip prefix for image captioning

Original

Ron Mokady, Amir Hertz, and Amit H Bermano. 2021 · 2021

Cited alongside, same era.

Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023 · 2023

Later among the works it cites.

Instructblip: Towards general-purpose vision-language models with instruction tuning

Original

Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, and Steven Hoi. 2023 · 2023

Later among the works it cites.

Gptscore: Evaluate as you desire

Original

Jinlan Fu, See-Kiong Ng, Zhengbao Jiang, and Pengfei Liu. 2023 · 2023

Later among the works it cites.

InfoMetIC: An informative metric for reference-free image caption evaluation

Anwen Hu, Shizhe Chen, Liang Zhang, and Qin Jin. 2023 · 2023

Later among the works it cites.

Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models