Fetching the paper…
Reading the bibliography…
This introduction aims to tell the story of how we put words into computers.
Assessing BERT’s syntactic abilities, 2019
Yoav Goldberg · 1901
Earlier work this paper cites.
RoBERTa: A robustly optimized BERT pretraining approach, 2019b
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 1907
Earlier work this paper cites.
Exploring the limits of transfer learning with a unified text-to-text transformer, 2019
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu · 1910
Earlier work this paper cites.
A synopsis of linguistic theory 1930–1955
J. R. Firth · 1957
Earlier work this paper cites.
Indexing by latent semantic analysis
Scott C. Deerwester, Susan T. Dumais, Thomas K. Landauer, George W. Furnas, and Richard A. Harshman · 1990
Earlier work this paper cites.
Class-based n n -gram models of natural language
Peter F. Brown, Peter V. Desouza, Robert L. Mercer, Vincent J. Della Pietra, and Jenifer C. Lai · 1992
Earlier work this paper cites.
WordNet: An Electronic Lexical Database
Christiane Fellbaum, editor · 1998
Earlier work this paper cites.
Opinion Mining and Sentiment Analysis , volume 2 of Foundations and Trends® in Information Retrieval
Bo Pang and Lillian Lee · 2008
Earlier work this paper cites.
From frequency to meaning: Vector space models of semantics
Peter D. Turney and Patrick Pantel · 2010
Earlier work this paper cites.
Natural language processing (almost) from scratch
Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa · 2011
Earlier work this paper cites.
LSTM neural networks for language modeling
Martin Sundermeyer, Ralf Schlüter, and Hermann Ney · 2012
Earlier work this paper cites.
Linguistic Fundamentals for Natural Language Processing: 100 Essentials from Morphology and Syntax
Emily M. Bender · 2013
Cited alongside, same era.
Efficient estimation of word representations in vector space
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean · 2013
Cited alongside, same era.
Improved part-of-speech tagging for online conversational text with word clusters
Olutobi Owoputi, Brendan O’Connor, Chris Dyer, Kevin Gimpel, Nathan Schneider, and Noah A. Smith · 2013
Cited alongside, same era.
Improving vector space word representations using multilingual correlation
Manaal Faruqui and Chris Dyer · 2014
Cited alongside, same era.
Semisupervised sequence learning
Andrew M. Dai and Quoc V. Le · 2015
Cited alongside, same era.
Retrofitting word vectors to semantic lexicons
Manaal Faruqui, Jesse Dodge, Sujay Kumar Jauhar, Chris Dyer, Eduard Hovy, and Noah A. Smith · 2015
Universal language model fine-tuning for text classification, 2018
Jeremy Howard and Sebastian Ruder · 2018
Later among the works it cites.
SWAG: A large-scale adversarial dataset for grounded commonsense inference
Rowan Zellers, Yonatan Bisk, Roy Schwartz, and Yejin Choi · 2018
Later among the works it cites.
Linguistic Fundamentals for Natural Language Processing II: 100 Essentials from Semantics and Pragmatics
Emily M. Bender and Alex Lascarides · 2019
Closest in time.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Closest in time.
Introduction to Natural Language Processing
Jacob Eisenstein · 2019
Closest in time.
Variational pretraining for semi-supervised text classification
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Finding function in form: Compositional character models for open vocabulary word representation
Wang Ling, Tiago Luís, Luís Marujo, Ramón Fernandez Astudillo, Silvio Amir, Chris Dyer, Alan W. Black, and Isabel Trancoso · 2015
Cited alongside, same era.
Man is to computer programmer as woman is to homemaker? debiasing word embeddings
Tolga Bolukbasi, Kai-Wei Chang, James Y. Zou, Venkatesh Saligrama, and Adam T. Kalai · 2016
Cited alongside, same era.
Semantics derived automatically from language corpora contain human biases
Aylin Caliskan, Joanna J. Bryson, and Arvind Narayanan · 2017
Cited alongside, same era.
Neural Network Methods for Natural Language Processing
Yoav Goldberg · 2017
Cited alongside, same era.
Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
Daniel Jurafsky and James H. Martin
Cited in the paper.
Linguistic knowledge and transferability of contextual representations
Nelson F. Liu, Matt Gardner, Yonatan Belinkov, Matthew E. Peters, and Noah A. Smith
Cited in the paper.
Suchin Gururangan, Tam Dang, Dallas Card, and Noah A. Smith · 2019
Closest in time.
Cross-lingual language model pretraining
Guillaume Lample and Alexis Conneau · 2019
Closest in time.
Polyglot contextual representations improve crosslingual transfer
Phoebe Mulcaire, Jungo Kasai, and Noah A. Smith · 2019
Closest in time.
Language models are unsupervised multitask learners, 2019
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever · 2019
Closest in time.
XLNet: Generalized autoregressive pretraining for language understanding
Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Ruslan Salakhutdinov, and Quoc V. Le · 2019
Closest in time.