ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering

Low-level components of analytic activity in information visualization

Robert Amar, James Eagan, and John Stasko. 2005 · 2005

Earlier work this paper cites.

Graphical overlays: Using layered elements to aid chart reading

Nicholas Kong and Maneesh Agrawala. 2012 · 2012

Earlier work this paper cites.

Visualization analysis and design

Tamara Munzner. 2014 · 2014

Earlier work this paper cites.

Dvqa: Understanding data visualizations via question answering

Kushal Kafle, Brian Price, Scott Cohen, and Christopher Kanan. 2018 · 2018

Earlier work this paper cites.

Figureqa: An annotated figure dataset for visual reasoning

Original

Samira Ebrahimi Kahou, Vincent Michalski, Adam Atkinson, Akos Kadar, Adam Trischler, and Yoshua Bengio. 2018 · 2018

Earlier work this paper cites.

Task-based effectiveness of basic visualizations

Bahador Saket, Alex Endert, and Çagatay Demiralp. 2019 · 2019

Earlier work this paper cites.

Plotqa: Reasoning over scientific plots

Nitesh Methani, Pritha Ganguly, Mitesh M. Khapra, and Pratyush Kumar. 2020 · 2020

Earlier work this paper cites.

Making data visualization more efficient and effective: a survey

Xuedi Qin, Yuyu Luo, Nan Tang, and Guoliang Li. 2020 · 2020

Earlier work this paper cites.

Synthesizing natural language to visualization (NL2VIS) benchmarks from NL2SQL benchmarks

Yuyu Luo, Nan Tang, Guoliang Li, Chengliang Chai, Wenbo Li, and Xuedi Qin. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Original

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021 · 2021

Earlier work this paper cites.

Visualgpt: Data-efficient adaptation of pretrained language models for image captioning

Original

Jun Chen, Han Guo, Kai Yi, Boyang Li, and Mohamed Elhoseiny. 2022 · 2022

Earlier work this paper cites.

Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation

Original

Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022 · 2022

Earlier work this paper cites.

Chartqa: A benchmark for question answering about charts with visual and logical reasoning

Ahmed Masry, Do Xuan Long, Jia Qing Tan, Shafiq R. Joty, and Enamul Hoque. 2022 · 2022

Earlier work this paper cites.

Hierarchical text-conditional image generation with clip latents

Original

Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022 · 2022

Earlier work this paper cites.

Sevi: Speech-to-visualization through neural machine translation

Jiawei Tang, Yuyu Luo, Mourad Ouzzani, Guoliang Li, and Hongyang Chen. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V. Le, and Denny Zhou. 2022 · 2022

Earlier work this paper cites.

Qwen-vl: A versatile vision-language model for understanding, localization, text reading, and beyond

Original

Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou. 2023 · 2023

Earlier work this paper cites.

Making large multimodal models understand arbitrary visual prompts

Original

Mu Cai, Haotian Liu, Siva Karthik Mustikovela, Gregory P Meyer, Yuning Chai, Dennis Park, and Yong Jae Lee. 2023 · 2023

Cited alongside, same era.

Chartreader: A unified framework for chart derendering and comprehension without heuristic rules

Zhi-Qi Cheng, Qi Dai, and Alexander G. Hauptmann. 2023 · 2023

Cited alongside, same era.

Chartllama: A multimodal llm for chart understanding and generation

Original

Yucheng Han, Chi Zhang, Xin Chen, Xu Yang, Zhibin Wang, Gang Yu, Bin Fu, and Hanwang Zhang. 2023 · 2023

Cited alongside, same era.

Do lvlms understand charts? analyzing and correcting factual errors in chart captioning

Original

Kung-Hsiang Huang, Mingyang Zhou, Hou Pong Chan, Yi R. Fung, Zhenhailong Wang, Lingyu Zhang, Shih-Fu Chang, and Heng Ji. 2023 · 2023

Cited alongside, same era.

A review and collation of graphical perception knowledge for visualization recommendation

Zehua Zeng and Leilani Battle. 2023 · 2023

Later among the works it cites.

Enhanced chart understanding in vision and language task via cross-modal pre-training on plot table pairs

Original

Mingyang Zhou, Yi R. Fung, Long Chen, Christopher Thomas, Heng Ji, and Shih-Fu Chang. 2023 · 2023

Later among the works it cites.

Claude 3

Anthropic. 2024 · 2024

Closest in time.

Mme: A comprehensive evaluation benchmark for multimodal large language models

Original

Chaoyou Fu, Peixian Chen, Yunhang Shen, Yulei Qin, Mengdan Zhang, Xu Lin, Jinrui Yang, Xiawu Zheng, Ke Li, Xing Sun, Yunsheng Wu, and Rongrong Ji. 2024 · 2024

Closest in time.

Minicpm: Unveiling the potential of small language models with scalable training strategies

Original

Shengding Hu, Yuge Tu, Xu Han, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, Xinrong Zhang, Zheng Leng Thai, Kaihuo Zhang, Chongyi Wang, Yuan Yao, Chenyang Zhao, Jie Zhou, Jie Cai, Zhongwu Zhai, Ning Ding, Chao Jia, Guoyang Zeng, Dahai Li, Zhiyuan Liu, and Maosong Sun. 2024 · 2024