Fetching the paper…

Reading the bibliography…

2025

Infogen: Generating Complex Statistical Infographics from Documents

Ghosh, Akash, Garimella, Aparna, Ramu, Pritika et al.

Original
PDF
Post on X

Understand

Statistical infographics are powerful tools that simplify complex data into visually engaging and easy-to-understand formats.

Despite advancements in AI, particularly with LLMs, existing efforts have been limited to generating simple charts, with no prior work addressing the creation of complex infographics from text-heavy documents that demand a deep understanding of the content.
We address this gap by introducing the task of generating statistical infographics composed of multiple sub-charts (e.g., line, bar, pie) that are contextually accurate, insightful, and visually aligned.
To achieve this, we define infographic metadata that includes its title and textual insights, along with sub-chart-specific details such as their corresponding data and alignment.

Infogen: Generating Complex Statistical Infographics from Documents · Around

Built on

Huggingface’s transformers: State-of-the-art natural language processing
Original
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al. 2019 · 1910
Earlier work this paper cites.
Rouge: A package for automatic evaluation of summaries
Chin-Yew Lin. 2004 · 2004
Earlier work this paper cites.
Infographics: the new communication tools in digital age
Waralak V Siricharoen. 2013 · 2013
Earlier work this paper cites.
Data visualization
Matthew Sadiku, Adebowale E Shadare, Sarhan M Musa, Cajetan M Akujuobi, and Roy Perry. 2016 · 2016
Earlier work this paper cites.
Pytorch: An imperative style, high-performance deep learning library
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019 · 2019
Earlier work this paper cites.
Datashot: Automatic generation of fact sheets from tabular data
Yun Wang, Zhida Sun, Haidong Zhang, Weiwei Cui, Ke Xu, Xiaojuan Ma, and Dongmei Zhang. 2019 · 2019
Earlier work this paper cites.
Calliope: Automatic visual data story generation from a spreadsheet
Danqing Shi, Xinyue Xu, Fuling Sun, Yang Shi, and Nan Cao. 2020 · 2020
Earlier work this paper cites.
Chart-to-text: A large-scale benchmark for chart summarization
Original
Shankar Kantharaj, Rixie Tiffany Ko Leong, Xiang Lin, Ahmed Masry, Megh Thakkar, Enamul Hoque, and Shafiq Joty. 2022 · 2022
Earlier work this paper cites.
Qlora: Efficient finetuning of quantized llms
Original
Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023 · 2023
Earlier work this paper cites.
Lida: A tool for automatic generation of grammar-agnostic visualizations and infographics using large language models
Original
Victor Dibia. 2023 · 2023
Earlier work this paper cites.

Similar

A survey of generative ai applications
Original
Roberto Gozalo-Brizuela and Eduardo C. Garrido-Merchán. 2023 · 2023
Cited alongside, same era.
Chartllama: A multimodal llm for chart understanding and generation
Original
Yucheng Han, Chi Zhang, Xin Chen, Xu Yang, Zhibin Wang, Gang Yu, Bin Fu, and Hanwang Zhang. 2023 · 2023
Cited alongside, same era.
Unichart: A universal vision-language pretrained model for chart comprehension and reasoning
Original
Ahmed Masry, Parsa Kavehzadeh, Xuan Long Do, Enamul Hoque, and Shafiq Joty. 2023 · 2023
Cited alongside, same era.
Socrates: Data story generation via adaptive machine-guided elicitation of user feedback
Guande Wu, Shunan Guo, Jane Hoffswell, Gromit Yeuk-Yin Chan, Ryan A Rossi, and Eunyee Koh. 2023 · 2023
Cited alongside, same era.
Structchart: Perception, structuring, reasoning for visual chart understanding

Then

Instruction matters, a simple yet effective task selection approach in instruction tuning for specific tasks
Original
Changho Lee, Janghoon Han, Seonghyeon Ye, Stanley Jungkyu Choi, Honglak Lee, and Kyunghoon Bae. 2024 · 2024
Later among the works it cites.
Line charts in python
Plotly. 2024 · 2024
Later among the works it cites.
Plotnine: A grammar of graphics for python
Plotnine. 2024 · 2024
Later among the works it cites.
Direct preference optimization: Your language model is secretly a reward model
Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. 2024 · 2024
Later among the works it cites.
Unveiling hallucination in text, image, video, and audio foundation models: A comprehensive survey
Original
Pranab Sahoo, Prabhash Meharia, Akash Ghosh, Sriparna Saha, Vinija Jain, and Aman Chadha. 2024 · 2024
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Renqiu Xia, Bo Zhang, Haoyang Peng, Hancheng Ye, Xiangchao Yan, Peng Ye, Botian Shi, Yu Qiao, and Junchi Yan. 2023 · 2023

Cited alongside, same era.

Coco: Testing code generation systems via concretized instructions

Original

Ming Yan, Junjie Chen, Jie M Zhang, Xuejie Cao, Chen Yang, and Mark Harman. 2023 · 2023

Cited alongside, same era.

Phi-3 technical report: A highly capable language model locally on your phone

Marah Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, et al. 2024 · 2024

Cited alongside, same era.

The llama 3 herd of models

Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, et al. 2024 · 2024

Cited alongside, same era.

Healthalignsumm: Utilizing alignment for multimodal summarization of code-mixed healthcare dialogues

Akash Ghosh, Arkadeep Acharya, Sriparna Saha, Gaurav Pandey, Dinesh Raghu, and Setu Sinha. 2024b · 2024

Cited alongside, same era.

Datanarrative: Automated data-driven storytelling with visualizations and texts

Mohammed Saidul Islam, Md Tahmid Rahman Laskar, Md Rizwan Parvez, Enamul Hoque, and Shafiq Joty. 2024 · 2024

Cited alongside, same era.

Adobe express: Online graphic design app

Adobe

Cited in the paper.

Exploring the frontier of vision-language models: A survey of current methodologies and future directions

Akash Ghosh, Arkadeep Acharya, Sriparna Saha, Vinija Jain, and Aman Chadha. 2024a

Cited in the paper.

Chartgpt: Leveraging llms to generate charts from abstract natural language

Yuan Tian, Weiwei Cui, Dazhen Deng, Xinjing Yi, Yurun Yang, Haidong Zhang, and Yingcai Wu. 2024 · 2024

Later among the works it cites.

Unsloth: Accelerate your machine learning projects

Unsloth. 2024 · 2024

Later among the works it cites.

Are llms ready for visualization?

Pere-Pau Vázquez. 2024 · 2024

Later among the works it cites.

Reft: Representation finetuning for language models

Zhengxuan Wu, Aryaman Arora, Zheng Wang, Atticus Geiger, Dan Jurafsky, Christopher D Manning, and Christopher Potts. 2024 · 2024

Later among the works it cites.