PROPHET: An Inferable Future Forecasting Benchmark with Causal Intervened Likelihood Estimation

Verification of forecasts expressed in terms of probability

Glenn W Brier. 1950 · 1950

Earlier work this paper cites.

An introduction to causal inference

Judea Pearl. 2010 · 2010

Earlier work this paper cites.

The Integrated Crisis Early Warning System (ICEWS)

Philip A Schrodt, David J Gerner, Peter W Foltz, Moon-Soo Cho, and Young Joon Park. 2012 · 2012

Earlier work this paper cites.

GDELT: Global Data on Events, Location, and Tone, 1979-2012

Kale Leetaru and Philip A Schrodt. 2013 · 2013

Earlier work this paper cites.

What happens next? event prediction using a compositional neural network model. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 30

Granroth-Wilding. 2016 · 2016

Earlier work this paper cites.

Lsdsem 2017 shared task: The story cloze test. In Proceedings of the 2nd Workshop on Linking Models of Lexical, Sentential and Discourse-level Semantics . 46–51

Nasrin Mostafazadeh, Michael Roth, Annie Louis, Nathanael Chambers, and James Allen. 2017 · 2017

Earlier work this paper cites.

HotpotQA: A dataset for diverse, explainable multi-hop question answering

Original

Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W Cohen, Ruslan Salakhutdinov, and Christopher D Manning. 2018 · 2018

Earlier work this paper cites.

Constructing a multi-hop QA dataset for comprehensive evaluation of reasoning steps

Original

Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, and Akiko Aizawa. 2020 · 2020

Earlier work this paper cites.

2WikiMultiHopQA: A Dataset for Multi-Hop Question Answering on Wikipedia. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics . Association for Computational Linguistics, Online, 7380–7391

Chin-Yew Lin, Xi Victoria Lin, and Jimmy Lin. 2020 · 2020

Earlier work this paper cites.

StrategyQA: A Question Answering Benchmark Requiring Strategy and Planning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics, Online, 5835–5847

Mor Geva, Daniel Khashabi, Tushar Khot, Ashish Sabharwal, and Dan Roth. 2021 · 2021

Earlier work this paper cites.

Measuring Massive Multitask Language Understanding

Dan Hendrycks, Collin Burns, Steven Basart, Andrew Critch, Jerry Li, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Earlier work this paper cites.

e-CARE: a New Dataset for Exploring Explainable Causal Reasoning. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . 432–446

Li Du, Xiao Ding, Kai Xiong, Ting Liu, and Bing Qin. 2022 · 2022

Earlier work this paper cites.

Event-level prediction of urban crime reveals a signature of enforcement bias in US cities

Victor Rotaru, Yi Huang, Timmy Li, James Evans, and Ishanu Chattopadhyay. 2022 · 2022

Earlier work this paper cites.

ASQA: Factoid Questions Meet Long-Form Answers

Ivan Stelmakh, Yi Luan, Bhuwan Dhingra, and Ming-Wei Chang. 2022 · 2022

Cited alongside, same era.

A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models. In The 61st Annual Meeting Of The Association For Computational Linguistics

Alessandro Stolfo, Zhijing Jin, Kumar Shridhar, Bernhard Schoelkopf, and Mrinmaya Sachan. 2023 · 2023

Cited alongside, same era.

React: Synergizing reasoning and acting in language models. In International Conference on Learning Representations (ICLR)

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2023 · 2023

Cited alongside, same era.

Distilling Script Knowledge from Large Language Models for Constrained Language Planning. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . 4303–4325

Siyu Yuan, Jiangjie Chen, Ziquan Fu, Xuyang Ge, Soham Shah, Charles Jankowski, Yanghua Xiao, and Deqing Yang. 2023 · 2023

Cited alongside, same era.

Benchmarking Large Language Models in Retrieval-Augmented Generation. In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence . AAAI Press, Washington, DC, USA, 17754–17762

Nianzu Liu, Tianyi Zhang, and Percy Liang. 2024 · 2024

Later among the works it cites.

WeQA: A Benchmark for Retrieval Augmented Generation in Wind Energy Domain

Original

Rounak Meyur, Hung Phan, Sridevi Wagle, Jan Strube, Mahantesh Halappanavar, Sameera Horawalavithana, Anurag Acharya, and Sai Munikoti. 2024 · 2024

Later among the works it cites.

Can Language Models Use Forecasting Strategies?

Original

Sarah Pratt, Seth Blumberg, Pietro Kreitlon Carolino, and Meredith Ringel Morris. 2024 · 2024

Later among the works it cites.

MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systems

Original