Fetching the paper…
Reading the bibliography…
Natural-language prompts have recently been used to coax pretrained language models into performing other AI tasks, using a fill-in-the-blank paradigm (Petroni et al., 2019) or a few-shot extrapolation paradigm (Brown et al., 2020).
Children’s Minds
M. C. Donaldson. 1978 · 1978
Earlier work this paper cites.
Automatic acquisition of hyponyms from large text corpora
M. A. Hearst. 1992 · 1992
Earlier work this paper cites.
The assumptions and theory of public opinion polling
David Broughton. 1995 · 1995
Earlier work this paper cites.
Deterministic annealing for clustering, compression, classification, regression, and related optimization problems
Kenneth Rose. 1998 · 1998
Earlier work this paper cites.
Learning dictionaries for information extraction by multi-level bootstrapping
E. Riloff and R. Jones. 1999 · 1999
Earlier work this paper cites.
Open Mind Common Sense: Knowledge acquisition from the general public
Push Singh, Thomas Lin, Erik T. Mueller, Grace Lim, Travell Perkins, and Wan Li Zhu. 2002 · 2002
Earlier work this paper cites.
Retrieval-augmented generation for knowledge-intensive NLP tasks
Patrick Lewis, Ethan Perez, Aleksandara Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020b · 2005
Earlier work this paper cites.
It’s not just size that matters: Small language models are also few-shot learners
Timo Schick and Hinrich Schütze. 2020b · 2009
Earlier work this paper cites.
50,000 lessons on how to read: A relation extraction corpus
Dave Orr. 2013 · 2013
Earlier work this paper cites.
Entity linking: Finding extracted entities in a knowledge base
Delip Rao, Paul McNamee, and Mark Dredze. 2013 · 2013
Earlier work this paper cites.
Don’t count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors
Marco Baroni, Georgiana Dinu, and Germán Kruszewski. 2014 · 2014
Earlier work this paper cites.
Overview of the English slot filling track at the TAC2014 knowledge base population evaluation
Mihai Surdeanu and Heng Ji. 2014 · 2014
Cited alongside, same era.
Adam: A method for stochastic optimization
D. P. Kingma and J. L. Ba. 2015 · 2015
Cited alongside, same era.
Neural architectures for named entity recognition
Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016 · 2016
Cited alongside, same era.
Context-aware representations for knowledge base relation extraction
Daniil Sorokin and Iryna Gurevych. 2017 · 2017
Cited alongside, same era.
ConceptNet 5.5: An open multilingual graph of general knowledge
R. Speer, J. Chin, and C. Havasi. 2017 · 2017
Cited alongside, same era.
Language models as knowledge bases?
F. Petroni, T. Rocktäschel, P. Lewis, A. Bakhtin, Y. Wu, A. H. Miller, and S. Riedel. 2019 · 2019
Later among the works it cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Later among the works it cites.
Inducing relational knowledge from BERT
Zied Bouraoui, Jose Camacho-Collados, and Steven Schockaert. 2020 · 2020
Later among the works it cites.
Language models are few-shot learners
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
T-REx: A large scale alignment of natural language with knowledge base triples
Hady Elsahar, Pavlos Vougiouklis, Arslen Remaci, Christophe Gravier, Jonathon Hare, Elena Simperl, and Frederique Laforest. 2018 · 2018
Cited alongside, same era.
Deep contextualized word representations
M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. S. Zettlemoyer. 2018 · 2018
Cited alongside, same era.
PIQA: Reasoning about physical commonsense in natural language
Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, and Yejin Choi. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
J. Devlin, M. Chang, K. Lee, and K. Toutanova. 2019 · 2019
Cited alongside, same era.
LINSPECTOR WEB: A multilingual probing suite for word representations
Max Eichler, Gözde Gül Şahin, and Iryna Gurevych. 2019 · 2019
Cited alongside, same era.
RoBERTa: A robustly optimized BERT pretraining approach
Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi, D. Chen, O. Levy, M. Lewis, L. S. Zettlemoyer, and V. Stoyanov. 2019 · 2019
Cited alongside, same era.
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. 2020a
Cited in the paper.
Zhengbao Jiang, Frank F. Xu, Jun Araki, and Graham Neubig. 2020 · 2020
Later among the works it cites.
A primer in BERTology: What we know about how BERT works
Anna Rogers, Olga Kovaleva, and Anna Rumshisky. 2020 · 2020
Later among the works it cites.
AutoPrompt: Eliciting knowledge from language models with automatically generated prompts
Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, Eric Wallace, and Sameer Singh. 2020 · 2020
Later among the works it cites.
oLMpics – On what language model pre-training captures
Alon Talmor, Yanal Elazar, Yoav Goldberg, and Jonathan Berant. 2020 · 2020
Later among the works it cites.
Prefix-tuning: Optimizing continuous prompts for generation
Xiang Lisa Li and Percy Liang. 2021 · 2021
Closest in time.
Xiao Liu, Yanan Zheng, Zhengxiao Du, Ming Ding, Yujie Qian, Zhilin Yang, and Jie Tang. 2021 · 2021
Closest in time.
Exploiting cloze questions for few-shot text classification and natural language inference
Timo Schick and Hinrich Schütze. 2020a · 2021
Closest in time.