Fetching the paper…
Reading the bibliography…
Existing research often posits spurious features as easier to learn than core features in neural network optimization, but the impact of their relative simplicity remains under-explored.
SGD on Neural Networks Learns Functions of Increasing Complexity, May 2019
Preetum Nakkiran, Gal Kaplun, Dimitris Kalimeris, Tristan Yang, Benjamin L. Edelman, Fred Zhang, and Boaz Barak · 1905
Earlier work this paper cites.
Invariant Risk Minimization, March 2020
Martin Arjovsky, Léon Bottou, Ishaan Gulrajani, and David Lopez-Paz · 1907
Earlier work this paper cites.
Decoupling Representation and Classifier for Long-Tailed Recognition, February 2020
Bingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan, Albert Gordo, Jiashi Feng, and Yannis Kalantidis · 1910
Earlier work this paper cites.
Shiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, and Percy Liang · 1911
Earlier work this paper cites.
Increasing Robustness to Spurious Correlations using Forgettable Examples, February 2021
Yadollah Yaghoobzadeh, Soroush Mehri, Remi Tachet, T. J. Hazen, and Alessandro Sordoni · 1911
Earlier work this paper cites.
PyTorch: An Imperative Style, High-Performance Deep Learning Library, December 2019
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Köpf, Edward Yang, Zach DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala · 1912
Earlier work this paper cites.
Learning Parities with Neural Networks, July 2020
Amit Daniely and Eran Malach · 2002
Earlier work this paper cites.
Shortcut Learning in Deep Neural Networks
Robert Geirhos, Jörn-Henrik Jacobsen, Claudio Michaelis, Richard Zemel, Wieland Brendel, Matthias Bethge, and Felix A. Wichmann · 2004
Earlier work this paper cites.
An Investigation of Why Overparameterization Exacerbates Spurious Correlations, August 2020
Shiori Sagawa, Aditi Raghunathan, Pang Wei Koh, and Percy Liang · 2005
Earlier work this paper cites.
What shapes feature representations? Exploring datasets, architectures, and training, October 2020
Katherine L. Hermann and Andrew K. Lampinen · 2006
Earlier work this paper cites.
The Pitfalls of Simplicity Bias in Neural Networks, October 2020
Harshay Shah, Kaustav Tamuly, Aditi Raghunathan, Prateek Jain, and Praneeth Netrapalli · 2006
Earlier work this paper cites.
Noise or Signal: The Role of Image Backgrounds in Object Recognition, June 2020
Kai Xiao, Logan Engstrom, Andrew Ilyas, and Aleksander Madry · 2006
Earlier work this paper cites.
Understanding the Failure Modes of Out-of-Distribution Generalization, April 2021
Vaishnavh Nagarajan, Anders Andreassen, and Behnam Neyshabur · 2010
Earlier work this paper cites.
Scikit-learn: Machine Learning in Python
Fabian Pedregosa, Gael Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Edouard Duchesnay · 2011
Earlier work this paper cites.
Understanding Machine Learning: From Theory to Algorithms
Shai Shalev-Shwartz and Shai Ben-David · 2014
Earlier work this paper cites.
Deep Learning Face Attributes in the Wild, September 2015
Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang · 2015
Earlier work this paper cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell · 2017
Earlier work this paper cites.
Understanding intermediate layers using linear classifier probes, November 2018
Guillaume Alain and Yoshua Bengio · 2018
Earlier work this paper cites.
Towards a Definition of Disentangled Representations, December 2018
Irina Higgins, David Amos, David Pfau, Sebastien Racaniere, Loic Matthey, Danilo Rezende, and Alexander Lerchner · 2018
Earlier work this paper cites.
Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning
Daniel S. Kermany, Michael Goldbaum, Wenjia Cai, Carolina C. S. Valentim, Huiying Liang, Sally L. Baxter, Alex McKeown, Ge Yang, Xiaokang Wu, Fangbing Yan, Justin Dong, Made K. Prasadha, Jacqueline Pei, Magdalene Y. L. Ting, Jie Zhu, Christina Li, Sierra Hewett, Jason Dong, Ian Ziyar, Alexander Shi, Runze Zhang, Lianghong Zheng, Rui Hou, William Shi, Xin Fu, Yaou Duan, Viet A. N. Huu, Cindy Wen, Edward D. Zhang, Charlotte L. Zhang, Oulan Li, Xiaobo Wang, Michael A. Singer, Xiaodong Sun, Jie Xu, Ali Tafreshi, M. Anthony Lewis, Huimin Xia, and Kang Zhang · 2018
Cited alongside, same era.
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference, February 2018
Adina Williams, Nikita Nangia, and Samuel R. Bowman · 2018
Cited alongside, same era.
On the Fairness of Disentangled Representations
Francesco Locatello, Gabriele Abbati, Thomas Rainforth, Stefan Bauer, Bernhard Schölkopf, and Olivier Bachem · 2019
Cited alongside, same era.
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
Tom McCoy, Ellie Pavlick, and Tal Linzen · 2019
Cited alongside, same era.
Elan Rosenfeld, Pradeep Ravikumar, and Andrej Risteski · 2022
Later among the works it cites.
Damien Teney, Ehsan Abbasnejad, Simon Lucey, and Anton van den Hengel · 2022
Later among the works it cites.
Michael Zhang, Nimit S. Sohoni, Hongyang R. Zhang, Chelsea Finn, and Christopher Ré · 2022
Later among the works it cites.
SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics, August 2023
Emmanuel Abbe, Enric Boix-Adsera, and Theodor Misiakiewicz · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Nasim Rahaman, Aristide Baratin, Devansh Arpit, Felix Draxler, Min Lin, Fred A. Hamprecht, Yoshua Bengio, and Aaron Courville · 2019
Cited alongside, same era.
Guillermo Valle-Pérez, Chico Q. Camargo, and Ard A. Louis · 2019
Cited alongside, same era.
Learning from Failure: De-biasing Classifier from Biased Classifier
Junhyun Nam, Hyuntak Cha, Sungsoo Ahn, Jaeho Lee, and Jinwoo Shin · 2020
Cited alongside, same era.
Towards Debiasing NLU Models from Unknown Biases
Prasetya Ajie Utama, Nafise Sadat Moosavi, and Iryna Gurevych · 2020
Cited alongside, same era.
BiaSwap: Removing Dataset Bias with Bias-Tailored Swapping Augmentation
Eungyeup Kim, Jihyeon Lee, and Jaegul Choo · 2021
Cited alongside, same era.
Just Train Twice: Improving Group Robustness without Training Group Information, September 2021
Evan Zheran Liu, Behzad Haghgoo, Annie S. Chen, Aditi Raghunathan, Pang Wei Koh, Shiori Sagawa, Percy Liang, and Chelsea Finn · 2021
Cited alongside, same era.
Analysis of Boolean Functions, May 2021
Ryan O’Donnell · 2021
Cited alongside, same era.
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning, July 2021
Zixin Wen and Yuanzhi Li · 2021
Cited alongside, same era.
Boaz Barak, Benjamin L. Edelman, Surbhi Goel, Sham Kakade, Eran Malach, and Cyril Zhang · 2023
Later among the works it cites.
Understanding and Improving Feature Learning for Out-of-Distribution Generalization, October 2023
Yongqiang Chen, Wei Huang, Kaiwen Zhou, Yatao Bian, Bo Han, and James Cheng · 2023
Later among the works it cites.
A benchmark for toxic comment classification on Civil Comments dataset, January 2023
Corentin Duchene, Henri Jamet, Pierre Guillaume, and Reda Dehak · 2023
Later among the works it cites.
Pareto Frontiers in Neural Feature Learning: Data, Compute, Width, and Luck, September 2023
Benjamin L. Edelman, Surbhi Goel, Sham Kakade, Eran Malach, and Cyril Zhang · 2023
Later among the works it cites.
Margalit Glasgow · 2023
Later among the works it cites.
Siddharth Joshi, Yu Yang, Yihao Xue, Wenhan Yang, and Baharan Mirzasoleiman · 2023
Later among the works it cites.
Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations, June 2023
Polina Kirichenko, Pavel Izmailov, and Andrew Gordon Wilson · 2023
Later among the works it cites.
Towards Last-layer Retraining for Group Robustness with Fewer Annotations, November 2023
Tyler LaBonte, Vidya Muthukumar, and Abhishek Kumar · 2023
Later among the works it cites.
Diversify and Disambiguate: Learning From Underspecified Data, February 2023
Yoonho Lee, Huaxiu Yao, and Chelsea Finn · 2023
Later among the works it cites.
Avoiding spurious correlations via logit correction, February 2023
Sheng Liu, Xu Zhang, Nitesh Sekhar, Yue Wu, Prateek Singhal, and Carlos Fernandez-Granda · 2023
Later among the works it cites.
A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks, March 2023
William Merrill, Nikolaos Tsilivis, and Aman Shukla · 2023
Later among the works it cites.
Yihao Xue, Siddharth Joshi, Eric Gan, Pin-Yu Chen, and Baharan Mirzasoleiman · 2023
Later among the works it cites.
Identifying Spurious Biases Early in Training through the Lens of Simplicity Bias, May 2023
Yu Yang, Eric Gan, Gintare Karolina Dziugaite, and Baharan Mirzasoleiman · 2023
Later among the works it cites.
Haotian Ye, James Zou, and Linjun Zhang · 2023
Later among the works it cites.