Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging

RoBERTa: A Robustly Optimized BERT Pretraining Approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Aleatory or epistemic? does it matter?

Armen Der Kiureghian and Ove Ditlevsen. 2009 · 2009

Earlier work this paper cites.

SemEval-2012 task 6: A pilot on semantic textual similarity

Eneko Agirre, Daniel Cer, Mona Diab, and Aitor Gonzalez-Agirre. 2012 · 2012

Earlier work this paper cites.

A SICK cure for the evaluation of compositional distributional semantic models

Marco Marelli, Stefano Menini, Marco Baroni, Luisa Bentivogli, Raffaella Bernardi, and Roberto Zamparelli. 2014 · 2014

Earlier work this paper cites.

From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions

Peter Young, Alice Lai, Micah Hodosh, and Julia Hockenmaier. 2014 · 2014

Earlier work this paper cites.

A large annotated corpus for learning natural language inference

Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015 · 2015

Earlier work this paper cites.

Dropout as a bayesian approximation: Representing model uncertainty in deep learning

Yarin Gal and Zoubin Ghahramani. 2016 · 2016

Earlier work this paper cites.

Averaging weights leads to wider optima and better generalization

Pavel Izmailov, Dmitrii Podoprikhin, Timur Garipov, Dmitry Vetrov, and Andrew Gordon Wilson. 2018 · 2018

Earlier work this paper cites.

GLUE: A multi-task benchmark and analysis platform for natural language understanding

Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. 2018 · 2018

Cited alongside, same era.

A broad-coverage challenge corpus for sentence understanding through inference

Adina Williams, Nikita Nangia, and Samuel Bowman. 2018 · 2018

Cited alongside, same era.

A simple baseline for bayesian uncertainty in deep learning

Wesley J Maddox, Pavel Izmailov, Timur Garipov, Dmitry P Vetrov, and Andrew Gordon Wilson. 2019 · 2019

Cited alongside, same era.

Inherent disagreements in human textual inferences

Ellie Pavlick and Tom Kwiatkowski. 2019 · 2019

Cited alongside, same era.

Human uncertainty makes classification more robust

Joshua C. Peterson, Ruairidh M. Battleday, Thomas L. Griffiths, and Olga Russakovsky. 2019 · 2019

Cited alongside, same era.

Testing the generalization power of neural network models across NLI benchmarks

Bayesian deep learning and a probabilistic perspective of generalization

Andrew G Wilson and Pavel Izmailov. 2020 · 2020

Later among the works it cites.

Transformers: State-of-the-art natural language processing

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander Rush. 2020 · 2020

Later among the works it cites.

How emotionally stable is ALBERT? testing robustness with stochastic weight averaging on a sentiment analysis task

Urja Khurana, Eric Nalisnick, and Antske Fokkens. 2021 · 2021

Later among the works it cites.

Revisiting checkpoint averaging for neural machine translation

Yingbo Gao, Christian Herold, Zijian Yang, and Hermann Ney. 2022 · 2022

Later among the works it cites.

When do flat minima optimizers work?

Jean Kaddour, Linqing Liu, Ricardo Silva, and Matt Kusner. 2022 · 2022

Later among the works it cites.