Can Language Models Be Specific? How?

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 1901

Earlier work this paper cites.

Unifiedqa: Crossing format boundaries with a single qa system

Daniel Khashabi, Sewon Min, Tushar Khot, Ashish Sabharwal, Oyvind Tafjord, Peter Clark, and Hannaneh Hajishirzi. 2020 · 1907

Earlier work this paper cites.

Roberta: A robustly optimized bert pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Towards a human-like open-domain chatbot

Original

Daniel Adiwardana, Minh-Thang Luong, David R So, Jamie Hall, Noah Fiedel, Romal Thoppilan, Zi Yang, Apoorv Kulshreshtha, Gaurav Nemade, Yifeng Lu, et al. 2020 · 2001

Earlier work this paper cites.

Language models are open knowledge graphs

Original

Chenguang Wang, Xiao Liu, and Dawn Song. 2020 · 2010

Earlier work this paper cites.

Automatic identification of general and specific sentences by leveraging discourse annotations

Annie Louis and Ani Nenkova. 2011 · 2011

Earlier work this paper cites.

Wikidata: a free collaborative knowledgebase

Denny Vrandečić and Markus Krötzsch. 2014 · 2014

Earlier work this paper cites.

Targeted syntactic evaluation of language models

Rebecca Marvin and Tal Linzen. 2018 · 2018

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

Domain agnostic real-valued specificity prediction

Wei-Jen Ko, Greg Durrett, and Junyi Jessy Li. 2019 · 2019

Cited alongside, same era.

Language models as knowledge bases?

Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller. 2019 · 2019

Cited alongside, same era.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019

Cited alongside, same era.

Non-monotonic sequential text generation

Sean Welleck, Kianté Brantley, Hal Daumé Iii, and Kyunghyun Cho. 2019 · 2019

Cited alongside, same era.

Inducing relational knowledge from bert

Zied Bouraoui, Jose Camacho-Collados, and Steven Schockaert. 2020 · 2020

Cited alongside, same era.

X-factr: Multilingual factual knowledge retrieval from pretrained language models

Zhengbao Jiang, Antonios Anastasopoulos, Jun Araki, Haibo Ding, and Graham Neubig. 2020a · 2020

Eliciting knowledge from language models using automatically generated prompts

Taylor Shin, Yasaman Razeghi, Robert L Logan IV, Eric Wallace, and Sameer Singh. 2020 · 2020

Later among the works it cites.

Assessing phrasal representation and composition in transformers

Lang Yu and Allyson Ettinger. 2020 · 2020

Later among the works it cites.

How to query language models?

Original

Leonard Adolphs, Shehzaad Dhuliawala, and Thomas Hofmann. 2021 · 2021

Later among the works it cites.

Making pre-trained language models better few-shot learners

Tianyu Gao, Adam Fisch, and Danqi Chen. 2021 · 2021

Later among the works it cites.

Definition modelling for appropriate specificity

Han Huang, Tomoyuki Kajiwara, and Yuki Arase. 2021 · 2021

Later among the works it cites.

Phrase-bert: Improved phrase embeddings from bert with an application to corpus exploration