Fetching the paper…
Reading the bibliography…
Peer review is our best tool for judging the quality of conference submissions, but it is becoming increasingly spurious.
The Matthew Effect in Science: The reward and communication systems of science are considered
Robert K. Merton. 1968 · 1968
Earlier work this paper cites.
The fate of published articles, submitted again
Douglas P. Peters and Stephen J. Ceci. 1982 · 1982
Earlier work this paper cites.
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
Jesse Dodge, Gabriel Ilharco, Roy Schwartz, Ali Farhadi, Hannaneh Hajishirzi, and Noah Smith. 2020 · 2002
Earlier work this paper cites.
A Primer in BERTology: What we know about how BERT works
Anna Rogers, Olga Kovaleva, and Anna Rumshisky. 2020 · 2002
Earlier work this paper cites.
A Metric Learning Reality Check
Kevin Musgrave, Serge Belongie, and Ser-Nam Lim. 2020 · 2003
Earlier work this paper cites.
Reviewing the reviewers
Kenneth Church. 2005 · 2005
Earlier work this paper cites.
The shrinking horizons of computational linguistics
Ehud Reiter. 2007 · 2007
Earlier work this paper cites.
Conference reviewing considered harmful
Thomas Anderson. 2009 · 2009
Earlier work this paper cites.
Utility is in the Eye of the User: A Critique of NLP Leaderboards
Kawin Ethayarajh and Dan Jurafsky. 2020 · 2009
Earlier work this paper cites.
Relative status of journal and conference publications in computer science
Jill Freyne, Lorcan Coyle, Barry Smyth, and Padraig Cunningham. 2010 · 2010
Earlier work this paper cites.
Classical peer review: An empty gun
Richard Smith. 2010 · 2010
Earlier work this paper cites.
Improving our reviewing processes
Inderjeet Mani. 2011 · 2011
Earlier work this paper cites.
A quantitative analysis of peer review
Azzurra Ragone, Katsiaryna Mirylenka, Fabio Casati, and Maurizio Marchese. 2011 · 2011
Earlier work this paper cites.
Thinking, Fast and Slow , 1st pbk. ed edition
Daniel Kahneman. 2013 · 2013
Cited alongside, same era.
Efficient estimation of word representations in vector space
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013 · 2013
Cited alongside, same era.
On peer review in computer science: Analysis of its effectiveness and suggestions for improvement
Azzurra Ragone, Katsiaryna Mirylenka, Fabio Casati, and Maurizio Marchese. 2013 · 2013
Cited alongside, same era.
The NIPS experiment
Eric Price. 2014 · 2014
Cited alongside, same era.
Emerging trends: I did it, I did it, I did it, but…
Kenneth Ward Church. 2017 · 2017
Cited alongside, same era.
Questionable Answers in Question Answering Research: Reproducibility and Variability of Published Results
We Should Anonymize Model Names during Peer Review
Ryan Cotterell. 2019 · 2019
Later among the works it cites.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Later among the works it cites.
Show Your Work: Improved Reporting of Experimental Results
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, and Noah A. Smith. 2019 · 2019
Later among the works it cites.
Does My Rebuttal Matter? Insights from a Major NLP Conference
Yang Gao, Steffen Eger, Ilia Kuznetsov, Iryna Gurevych, and Yusuke Miyao. 2019 · 2019
Later among the works it cites.
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
Tom McCoy, Ellie Pavlick, and Tal Linzen. 2019 · 2019
Later among the works it cites.
How the Transformers broke NLP leaderboards
Anna Rogers. 2019 · 2019
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Matt Crane. 2018 · 2018
Cited alongside, same era.
A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications
Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine van Zuylen, Sebastian Kohlmeier, Eduard Hovy, and Roy Schwartz. 2018 · 2018
Cited alongside, same era.
A Neural Network Framework for Cognitive Bias
JE Korteling, AM Brouwer, and A Toet. 2018 · 2018
Cited alongside, same era.
Deep Contextualized Word Representations
Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018 · 2018
Cited alongside, same era.
The peer review system has flaws. But it’s still a barrier to bad science
Brenda Wingfield. 2018 · 2018
Cited alongside, same era.
PaRe: A Paper-Reviewer Matching Approach Using a Common Topic Space
Omer Anjum, Hongyu Gong, Suma Bhat, Wen-Mei Hwu, and JinJun Xiong. 2019 · 2019
Cited alongside, same era.
The #BenderRule: On Naming the Languages We Study and Why It Matters
Emily M. Bender. 2019 · 2019
Cited alongside, same era.
Later among the works it cites.
Stagnation and Scientific Incentives
Jay Bhattacharya and Mikko Packalen. 2020 · 2020
Closest in time.
Emerging trends: Reviewing the reviewers (again)
Kenneth Ward Church. 2020 · 2020
Closest in time.
Advice on Reviewing for EMNLP
Yang Liu, Trevor Cohn, Bonnie Webber, and Yulan He. 2020 · 2020
Closest in time.
Loss Functions, Axioms, and Peer Review
Ritesh Noothigattu, Nihar B. Shah, and Ariel D. Procaccia. 2020 · 2020
Closest in time.
Why do we still use 18-year old BLEU?
Ehud Reiter. 2020 · 2020
Closest in time.
Adversarial Examples for Evaluating Reading Comprehension Systems
Robin Jia and Percy Liang. 2017 · 2031
Closest in time.