Making Large Language Models into World Models with Precondition and Effect Knowledge

Measuring nominal scale agreement among many raters

Joseph L Fleiss. 1971 · 1971

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition

Erik F. Tjong Kim Sang and Fien De Meulder. 2003 · 2003

Earlier work this paper cites.

ROUGE: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

Learning high-level planning from text

S.R.K. Branavan, Nate Kushman, Tao Lei, and Regina Barzilay. 2012 · 2012

Earlier work this paper cites.

Tracking state changes in procedural text: a challenge dataset and models for process paragraph comprehension

Bhavana Dalvi, Lifu Huang, Niket Tandon, Wen-tau Yih, and Peter Clark. 2018 · 2018

Earlier work this paper cites.

Recurrent world models facilitate policy evolution

David Ha and Jürgen Schmidhuber. 2018 · 2018

Earlier work this paper cites.

Sentence mover’s similarity: Automatic evaluation for multi-sentence texts

Elizabeth Clark, Asli Celikyilmaz, and Noah A. Smith. 2019 · 2019

Earlier work this paper cites.

Decoupled weight decay regularization

Ilya Loshchilov and Frank Hutter. 2019 · 2019

Earlier work this paper cites.

Atomic: An atlas of machine commonsense for if-then reasoning

Maarten Sap, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A Smith, and Yejin Choi. 2019 · 2019

Earlier work this paper cites.

Narrative planning model acquisition from text summaries and descriptions

Thomas Hayton, Julie Porteous, Joao Ferreira, and Alan Lindsay. 2020 · 2020

Earlier work this paper cites.

Modeling preconditions in text with a crowd-sourced dataset

Heeyoung Kwon, Mahnaz Koupaee, Pratyush Singh, Gargi Sawhney, Anmol Shukla, Keerthi Kumar Kallur, Nathanael Chambers, and Niranjan Balasubramanian. 2020 · 2020

Earlier work this paper cites.

Planning to explore via self-supervised world models

Ramanan Sekar, Oleh Rybkin, Kostas Daniilidis, Pieter Abbeel, Danijar Hafner, and Deepak Pathak. 2020 · 2020

Earlier work this paper cites.

Transformers: State-of-the-art natural language processing

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander Rush. 2020 · 2020

Cited alongside, same era.

Toward diverse precondition generation

Heeyoung Kwon, Nathanael Chambers, and Niranjan Balasubramanian. 2021 · 2021

Cited alongside, same era.

Neurosymbolic Automated Story Generation

Lara J Martin. 2021 · 2021

Cited alongside, same era.

World model as a graph: Learning latent landmarks for planning

Lunjun Zhang, Ge Yang, and Bradly C Stadie. 2021 · 2021

Cited alongside, same era.

Chatgpt: A large-scale opendomain chatbot

OpenAI. 2022 · 2022

Cited alongside, same era.

PaCo: Preconditions attributed to commonsense knowledge

Ehsan Qasemi, Filip Ilievski, Muhao Chen, and Pedro Szekely. 2022a · 2022

Learning action conditions from instructional manuals for instruction understanding

Te-Lin Wu, Caiqi Zhang, Qingyuan Hu, Alexander Spangher, and Nanyun Peng. 2023 · 2023

Later among the works it cites.

Explainable reinforcement learning via a causal world model

Zhongwei Yu, Jingqing Ruan, and Dengpeng Xing. 2023 · 2023

Later among the works it cites.

How do large language models capture the ever-changing world knowledge? a review of recent advances

Zihan Zhang, Meng Fang, Ling Chen, Mohammad-Reza Namazi-Rad, and Jun Wang. 2023 · 2023

Later among the works it cites.

Berall: Towards generating retrieval-augmented state-based interactive fiction games

Rachel Chambers, Naomi Tack, Eliot Pearson, Lara J Martin, and Francis Ferraro. 2024 · 2024

Closest in time.

Scaling instruction-finetuned language models

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al. 2024 · 2024

Closest in time.