A Tale of a Probe and a Parser

Visualizing and measuring the geometry of BERT

Original

Andy Coenen, Emily Reif, Ann Yuan, Been Kim, Adam Pearce, Fernanda Viégas, and Martin Wattenberg. 2019 · 1906

Earlier work this paper cites.

HuggingFace’s Transformers: State-of-the-art natural language processing

Original

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, and Jamie Brew. 2019 · 1910

Earlier work this paper cites.

Shortest connection networks and some generalizations

R. C. Prim. 1957 · 1957

Earlier work this paper cites.

Dropout: A simple way to prevent neural networks from overfitting

Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014 · 1958

Earlier work this paper cites.

Algorithm 97: Shortest path

Robert W. Floyd. 1962 · 1962

Earlier work this paper cites.

A theorem on boolean matrices

Stephen Warshall. 1962 · 1962

Earlier work this paper cites.

Building a large annotated corpus of English: The Penn Treebank

Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993 · 1993

Earlier work this paper cites.

Non-projective dependency parsing using spanning tree algorithms

Ryan McDonald, Fernando Pereira, Kiril Ribarov, and Jan Hajič. 2005 · 2005

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik P. Kingma and Jimmy Ba. 2015 · 2015

Cited alongside, same era.

Universal dependencies v1: A multilingual treebank collection

Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Yoav Goldberg, Jan Hajič, Christopher D. Manning, Ryan McDonald, Slav Petrov, Sampo Pyysalo, Natalia Silveira, Reut Tsarfaty, and Daniel Zeman. 2016 · 2016

Cited alongside, same era.

Google’s neural machine translation system: Bridging the gap between human and machine translation

Original

Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2016 · 2016

Cited alongside, same era.

Understanding intermediate layers using linear classifier probes

Guillaume Alain and Yoshua Bengio. 2017 · 2017

Cited alongside, same era.

Collecting diverse natural language inference problems for sentence representation evaluation

Adam Poliak, Aparajita Haldar, Rachel Rudinger, J. Edward Hu, Ellie Pavlick, Aaron Steven White, and Benjamin Van Durme. 2018 · 2018

Later among the works it cites.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Later among the works it cites.

Designing and interpreting probes with control tasks

John Hewitt and Percy Liang. 2019 · 2019

Later among the works it cites.

A structural probe for finding syntax in word representations

John Hewitt and Christopher D. Manning. 2019 · 2019

Later among the works it cites.

Linguistic knowledge and transferability of contextual representations

Nelson F. Liu, Matt Gardner, Yonatan Belinkov, Matthew E. Peters, and Noah A. Smith. 2019 · 2019

Later among the works it cites.