Entailment Semantics Can Be Extracted from an Ideal Language Model

When redundancy is rational: A Bayesian approach to “overinformative” referring expressions

Original

Judith Degen, Robert XD Hawkins, Caroline Graf, Elisa Kreiss, and Noah D Goodman. 2019 · 1903

Earlier work this paper cites.

A synopsis of linguistic theory, 1930-1955

John R Firth. 1957 · 1955

Earlier work this paper cites.

Logic and conversation

Herbert P Grice. 1975 · 1975

Earlier work this paper cites.

Scorekeeping in a language game

David Lewis. 1979 · 1979

Earlier work this paper cites.

A theory of truth and semantic representation formal methods in the study of language, part 1, ed. by jeroen groenendijk, theo janssen and martin and stokhof

Hans A Kamp. 1981 · 1981

Earlier work this paper cites.

The semantics of definite and indefinite noun phrases

Irene Roswitha Heim. 1982 · 1982

Earlier work this paper cites.

Pragmatics

Stephen C Levinson, Stephen C Levinson, and S Levinson. 1983 · 1983

Earlier work this paper cites.

Semantics in Generative Grammar

Irene Heim and Angelika Kratzer. 1998 · 1998

Earlier work this paper cites.

NLTK: The Natural Language Toolkit

Steven Bird. 2006 · 2006

Cited alongside, same era.

Consistency and generalization bounds for maximum entropy density estimation

Original

Shaojun Wang, Russell Greiner, and Shaomin Wang. 2013 · 2013

Cited alongside, same era.

Probabilistic semantics and pragmatics: Uncertainty in language and thought

Noah D Goodman and Daniel Lassiter. 2015 · 2015

Cited alongside, same era.

Pragmatic language interpretation as probabilistic inference

Noah D Goodman and Michael C Frank. 2016 · 2016

Cited alongside, same era.

Deep contextualized word representations

Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018 · 2018

Cited alongside, same era.

BERT: Pre-training of deep bidirectional transformers for language understanding

To dissect an octopus: Making sense of the form/meaning debate

Julian Michael. 2020 · 2020

Later among the works it cites.

Is it possible for language models to achieve understanding?

Christopher Potts. 2020 · 2020

Later among the works it cites.

On the opportunities and risks of foundation models

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, and Percy Liang. 2021 · 2021