Towards Improving Selective Prediction Ability of NLP Systems

Automatically constructing a corpus of sentential paraphrases

William B Dolan and Chris Brockett. 2005 · 2005

Earlier work this paper cites.

On the foundations of noise-free selective classification

Ran El-Yaniv et al. 2010 · 2010

Earlier work this paper cites.

Scikit-learn: Machine learning in python

Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011 · 2011

Earlier work this paper cites.

A large annotated corpus for learning natural language inference

Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015 · 2015

Earlier work this paper cites.

Dropout as a bayesian approximation: Representing model uncertainty in deep learning

Yarin Gal and Zoubin Ghahramani. 2016 · 2016

Earlier work this paper cites.

A baseline for detecting misclassified and out-of-distribution examples in neural networks

Dan Hendrycks and Kevin Gimpel. 2017 · 2017

Earlier work this paper cites.

First quora dataset release: Question pairs

Shankar Iyer, Nikhil Dandekar, and Kornél Csernai. 2017 · 2017

Earlier work this paper cites.

Stress test evaluation for natural language inference

Aakanksha Naik, Abhilasha Ravichander, Norman Sadeh, Carolyn Rose, and Graham Neubig. 2018 · 2018

Cited alongside, same era.

A broad-coverage challenge corpus for sentence understanding through inference

Adina Williams, Nikita Nangia, and Samuel Bowman. 2018 · 2018

Cited alongside, same era.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Cited alongside, same era.

To annotate or not? predicting performance drop under domain shift

Hady Elsahar and Matthias Gallé. 2019 · 2019

Cited alongside, same era.

Selective question answering under domain shift

Amita Kamath, Robin Jia, and Percy Liang. 2020 · 2020

Cited alongside, same era.

The effect of natural distribution shift on question answering models

John Miller, Karl Krauth, Benjamin Recht, and Ludwig Schmidt. 2020 · 2020

Will this question be answered? question filtering via answer model distillation for efficient question answering

Siddhant Garg and Alessandro Moschitti. 2021 · 2021

Closest in time.

The many faces of robustness: A critical analysis of out-of-distribution generalization

Dan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath, Frank Wang, Evan Dorundo, Rahul Desai, Tyler Zhu, Samyak Parajuli, Mike Guo, et al. 2021 · 2021

Closest in time.

Wilds: A benchmark of in-the-wild distribution shifts

Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, Richard Lanas Phillips, Irena Gao, Tony Lee, Etienne David, Ian Stavness, Wei Guo, Berton Earnshaw, Imran Haque, Sara M Beery, Jure Leskovec, Anshul Kundaje, Emma Pierson, Sergey Levine, Chelsea Finn, and Percy Liang. 2021 · 2021

Closest in time.

How robust are model rankings: A leaderboard customization approach for equitable evaluation

Swaroop Mishra and Anjana Arunkumar. 2021 · 2021

Closest in time.

Evaluation examples are not equally informative: How should that change NLP leaderboards?

Pedro Rodriguez, Joe Barrow, Alexander Miserlis Hoyle, John P. Lalor, Robin Jia, and Jordan Boyd-Graber. 2021 · 2021