Think&Cite: Improving Attributed Text Generation with Self-Guided Tree Search and Progress Reward Modeling

A formal basis for the heuristic determination of minimum cost paths

Peter E. Hart, Nils J. Nilsson, and Bertram Raphael. 1968 · 1968

Earlier work this paper cites.

Bandit based Monte-Carlo planning

Levente Kocsis and Csaba Szepesvári. 2006 · 2006

Earlier work this paper cites.

The probabilistic relevance framework: BM25 and beyond

Stephen Robertson, Hugo Zaragoza, et al. 2009 · 2009

Earlier work this paper cites.

Thinking, fast and slow

Daniel Kahneman. 2011 · 2011

Earlier work this paper cites.

A survey of Monte Carlo tree search methods

Cameron Browne, Edward Jack Powley, Daniel Whitehouse, Simon M. Lucas, Peter I. Cowling, Philipp Rohlfshagen, Stephen Tavener, Diego Perez Liebana, Spyridon Samothrakis, and Simon Colton. 2012 · 2012

Earlier work this paper cites.

Mastering the game of Go with deep neural networks and tree search

David Silver, Aja Huang, Chris J. Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Vedavyas Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy P. Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, and Demis Hassabis. 2016 · 2016

Earlier work this paper cites.

ELI5: long form question answering

Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, and Michael Auli. 2019 · 2019

Earlier work this paper cites.

The bitter lesson

Richard Sutton. 2019 · 2019

Earlier work this paper cites.

Language models are few-shot learners

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 2020

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive NLP tasks

Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020 · 2020

Earlier work this paper cites.

The web is your oyster - knowledge-intensive NLP against a very large web corpus

Original

Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Dmytro Okhonko, Samuel Broscheit, Gautier Izacard, Patrick S. H. Lewis, Barlas Oguz, Edouard Grave, Wen-tau Yih, and Sebastian Riedel. 2021 · 2021

Earlier work this paper cites.

Mastering Atari games with limited data

Weirui Ye, Shaohuai Liu, Thanard Kurutach, Pieter Abbeel, and Yang Gao. 2021 · 2021

Earlier work this paper cites.

QAMPARI: An open-domain question answering benchmark for questions with many answers from multiple paragraphs

Original

Samuel Joseph Amouyal, Ohad Rubin, Ori Yoran, Tomer Wolfson, Jonathan Herzig, and Jonathan Berant. 2022 · 2022

Earlier work this paper cites.

TRUE: re-evaluating factual consistency evaluation

Or Honovich, Roee Aharoni, Jonathan Herzig, Hagai Taitelbaum, Doron Kukliansky, Vered Cohen, Thomas Scialom, Idan Szpektor, Avinatan Hassidim, and Yossi Matias. 2022 · 2022

Earlier work this paper cites.

Large dual encoders are generalizable retrievers

Jianmo Ni, Chen Qu, Jing Lu, Zhuyun Dai, Gustavo Hernández Ábrego, Ji Ma, Vincent Y. Zhao, Yi Luan, Keith B. Hall, Ming-Wei Chang, and Yinfei Yang. 2022 · 2022

Earlier work this paper cites.

ASQA: factoid questions meet long-form answers

Ivan Stelmakh, Yi Luan, Bhuwan Dhingra, and Ming-Wei Chang. 2022 · 2022

Earlier work this paper cites.

React: Synergizing reasoning and acting in language models

Original

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2022 · 2022

Cited alongside, same era.

Fireact: Toward language agent fine-tuning

Original

Baian Chen, Chang Shu, Ehsan Shareghi, Nigel Collier, Karthik Narasimhan, and Shunyu Yao. 2023 · 2023

Cited alongside, same era.

RARR: researching and revising what language models say, using language models

Luyu Gao, Zhuyun Dai, Panupong Pasupat, Anthony Chen, Arun Tejasvi Chaganty, Yicheng Fan, Vincent Y. Zhao, Ni Lao, Hongrae Lee, Da-Cheng Juan, and Kelvin Guu. 2023a · 2023

Cited alongside, same era.

Enabling large language models to generate text with citations

Tianyu Gao, Howard Yen, Jiatong Yu, and Danqi Chen. 2023b · 2023

Cited alongside, same era.

A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions

Original

Self-rag: Learning to retrieve, generate, and critique through self-reflection

Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi. 2024 · 2024

Closest in time.

Large language monkeys: Scaling inference compute with repeated sampling

Original

Bradley C. A. Brown, Jordan Juravsky, Ryan Saul Ehrlich, Ronald Clark, Quoc V. Le, Christopher Ré, and Azalia Mirhoseini. 2024 · 2024

Closest in time.

Learning to plan and generate text with citations

Constanza Fierro, Reinald Kim Amplayo, Fantine Huot, Nicola De Cao, Joshua Maynez, Shashi Narayan, and Mirella Lapata. 2024 · 2024

Closest in time.

V-STaR: Training verifiers for self-taught reasoners

Original

Arian Hosseini, Xingdi Yuan, Nikolay Malkin, Aaron C. Courville, Alessandro Sordoni, and Rishabh Agarwal. 2024 · 2024

Closest in time.

Training language models to generate text with citations via fine-grained rewards

Chengyu Huang, Zeqiu Wu, Yushi Hu, and Wenya Wang. 2024 · 2024