OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens

Explaining black box predictions and unveiling data artifacts through influence functions

Original

Xiaochuang Han, Byron C. Wallace, and Yulia Tsvetkov. 2020 · 2005

Earlier work this paper cites.

Understanding black-box predictions via influence functions

Pang Wei Koh and Percy Liang. 2017 · 2017

Earlier work this paper cites.

Rarr: Researching and revising what language models say, using language models

Luyu Gao, Zhuyun Dai, Panupong Pasupat, Anthony Chen, Arun Tejasvi Chaganty, Yicheng Fan, Vincent Zhao, N. Lao, Hongrae Lee, Da-Cheng Juan, and Kelvin Guu. 2022 · 2022

Earlier work this paper cites.

Orca: Interpreting prompted language models via locating supporting data evidence in the ocean of pretraining data

Original

Xiaochuang Han and Yulia Tsvetkov. 2022 · 2022

Earlier work this paper cites.

Judging llm-as-a-judge with mt-bench and chatbot arena

Original

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Haotong Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023 · 2023

Cited alongside, same era.

Training language models to generate text with citations via fine-grained rewards

Chengyu Huang, Zeqiu Wu, Yushi Hu, and Wenya Wang. 2024 · 2024

Cited alongside, same era.

Source-aware training enables knowledge attribution in language models

Original

Muhammad Khalifa, David Wadden, Emma Strubell, Honglak Lee, Lu Wang, Iz Beltagy, and Hao Peng. 2024 · 2024

Cited alongside, same era.

Infini-gram: Scaling unbounded n-gram language models to a trillion tokens

Original

Jiacheng Liu, Sewon Min, Luke S. Zettlemoyer, Yejin Choi, and Hannaneh Hajishirzi. 2024 · 2024

Cited alongside, same era.

Olmoe: Open mixture-of-experts language models

Original

Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Jacob Daniel Morrison, Sewon Min, Weijia Shi, Pete Walsh, Oyvind Tafjord, Nathan Lambert, Yuling Gu, Shane Arora, Akshita Bhagia, Dustin Schwenk, David Wadden, Alexander Wettig, Binyuan Hui, Tim Dettmers, Douwe Kiela, and 5 others. 2024 · 2024

Later among the works it cites.

2 olmo 2 furious

Original

Team OLMo, Pete Walsh, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Shane Arora, Akshita Bhagia, Yuling Gu, Shengyi Huang, Matt Jordan, Nathan Lambert, Dustin Schwenk, Oyvind Tafjord, Taira Anderson, David Atkinson, Faeze Brahman, Christopher Clark, Pradeep Dasigi, Nouha Dziri, and 21 others. 2024 · 2024

Later among the works it cites.

Selfcite: Self-supervised alignment for context attribution in large language models

Yung-Sung Chuang, Benjamin Cohen-Wang, Shannon Zejiang Shen, Zhaofeng Wu, Hu Xu, Xi Victoria Lin, James Glass, Shang-Wen Li, and Wen tau Yih. 2025 · 2025

Closest in time.