A Baseline Analysis of Reward Models' Ability To Accurately Analyze Foundation Models Under Distribution Shift

Fine-tuning language models from human preferences

Original

Ziegler, D. M.; Stiennon, N.; Wu, J.; Brown, T. B.; Radford, A.; Amodei, D.; Christiano, P.; and Irving, G. 2019 · 1909

Earlier work this paper cites.

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Original

He, P.; Liu, X.; Gao, J.; and Chen, W. 2021 · 2006

Earlier work this paper cites.

A baseline for detecting misclassified and out-of-distribution examples in neural networks

Original

Hendrycks, D.; and Gimpel, K. 2016 · 2016

Earlier work this paper cites.

Deep reinforcement learning from human preferences

Christiano, P. F.; Leike, J.; Brown, T.; Martic, M.; Legg, S.; and Amodei, D. 2017 · 2017

Earlier work this paper cites.

On calibration of modern neural networks

Guo, C.; Pleiss, G.; Sun, Y.; and Weinberger, K. Q. 2017 · 2017

Earlier work this paper cites.

Enhancing the reliability of out-of-distribution image detection in neural networks

Original

Liang, S.; Li, Y.; and Srikant, R. 2017 · 2017

Earlier work this paper cites.

A simple unified framework for detecting out-of-distribution samples and adversarial attacks

Lee, K.; Lee, K.; Lee, H.; and Shin, J. 2018 · 2018

Earlier work this paper cites.

Beyond temperature scaling: Obtaining well-calibrated multi-class probabilities with dirichlet calibration

Kull, M.; Perello Nieto, M.; Kängsepp, M.; Silva Filho, T.; Song, H.; and Flach, P. 2019 · 2019

Earlier work this paper cites.

Can you trust your model's uncertainty? Evaluating predictive uncertainty under dataset shift

Ovadia, Y.; Fertig, E.; Ren, J.; Nado, Z.; Sculley, D.; Nowozin, S.; Dillon, J.; Lakshminarayanan, B.; and Snoek, J. 2019 · 2019

Earlier work this paper cites.

Accurate Layerwise Interpretable Competence Estimation

Rajendran, V.; and LeVine, W. 2019 · 2019

Cited alongside, same era.

Generalized odin: Detecting out-of-distribution image without learning from out-of-distribution data

Hsu, Y.-C.; Shen, Y.; Jin, H.; and Kira, Z. 2020 · 2020

Cited alongside, same era.

Energy-based out-of-distribution detection

Liu, W.; Wang, X.; Owens, J.; and Li, Y. 2020 · 2020

Cited alongside, same era.

Learning to summarize from human feedback

Stiennon, N.; Ouyang, L.; Wu, J.; Ziegler, D. M.; Lowe, R.; Voss, C.; Radford, A.; Amodei, D.; and Christiano, P. 2020 · 2020

Cited alongside, same era.

OPUS-MT — Building open translation services for the World

Tiedemann, J.; and Thottingal, S. 2020 · 2020

Cited alongside, same era.

On the importance of gradients for detecting distributional shifts in the wild

Huang, R.; Geng, A.; and Li, Y. 2021 · 2021

Training ood detectors in their natural habitats

Katz-Samuels, J.; Nakhleh, J. B.; Nowak, R.; and Li, Y. 2022 · 2022

Later among the works it cites.

Out-of-distribution Detection with Deep Nearest Neighbors

Original

Sun, Y.; Ming, Y.; Zhu, X.; and Li, Y. 2022 · 2022

Later among the works it cites.

Generalization Analogies: A Testbed for Generalizing AI Oversight to Hard-To-Measure Domains

Original

Clymer, J.; Baker, G.; Subramani, R.; and Wang, S. 2023 · 2023

Closest in time.

OpenAssistant Conversations - Democratizing Large Language Model Alignment

Original

Köpf, A.; Kilcher, Y.; von Rütte, D.; Anagnostidis, S.; Tam, Z.; Stevens, K.; Barhoum, A.; Duc, N. M.; Stanley, O.; Nagyfi, R.; ES, S.; Suri, S.; Glushkov, D.; Dantuluri, A.; Maguire, A.; Schuhmann, C.; Nguyen, H.; and Mattick, A. 2023 · 2023

Closest in time.

Enabling Calibration In The Zero-Shot Inference of Large Vision-Language Models