Fetching the paper…
Reading the bibliography…
Recent advances on large-scale pre-training have shown great potentials of leveraging a large set of Pre-Trained Models (PTMs) for improving Out-of-Distribution (OoD) generalization, for which the goal is to perform well on possible unseen domains after fine-tuning on multiple training domains.
A new measure of rank correlation
Maurice G Kendall · 1938
Earlier work this paper cites.
A stochastic approximation method
Herbert Robbins and Sutton Monro · 1951
Earlier work this paper cites.
Bayesian variable selection in linear regression
Toby J Mitchell and John J Beauchamp · 1988
Earlier work this paper cites.
Stochastic search variable selection
Edward I George and Robert E McCulloch · 1995
Earlier work this paper cites.
Probable networks and plausible predictions—a review of practical bayesian methods for supervised neural networks
David JC MacKay · 1995
Earlier work this paper cites.
Approaches for bayesian variable selection
Edward I George and Robert E McCulloch · 1997
Earlier work this paper cites.
Choice of basis for laplace approximation
David J. C. MacKay · 1998
Earlier work this paper cites.
Ensemble methods in machine learning
Thomas G Dietterich · 2000
Earlier work this paper cites.
Variational bayesian model selection for mixture distributions
Adrian Corduneanu and Christopher M Bishop · 2001
Earlier work this paper cites.
Spike and slab variable selection: frequentist and bayesian strategies
Hemant Ishwaran and J Sunil Rao · 2005
Earlier work this paper cites.
Pattern recognition
Christopher M Bishop · 2006
Earlier work this paper cites.
Nonparametric bayesian model selection and averaging
Subhashis Ghosal, Jüri Lember, and Aad Van Der Vaart · 2008
Earlier work this paper cites.
Mixtures of g priors for bayesian variable selection
Feng Liang, Rui Paulo, German Molina, Merlise A Clyde, and Jim O Berger · 2008
Earlier work this paper cites.
Consistency of bayesian procedures for variable selection
George Casella, F Javier Girón, M Lina Martínez, and Elias Moreno · 2009
Earlier work this paper cites.
A review of bayesian variable selection methods: what, how and which
Robert B O’Hara and Mikko J Sillanpää · 2009
Earlier work this paper cites.
Bayesian variable selection in structured high-dimensional covariate spaces with applications in genomics
Fan Li and Nancy R Zhang · 2010
Earlier work this paper cites.
Mcmc using hamiltonian dynamics
Radford M Neal et al · 2011
Earlier work this paper cites.
Unbiased metric learning: On the utilization of multiple datasets and web images for softening bias
Chen Fang, Ye Xu, and Daniel N. Rockmore · 2013
Earlier work this paper cites.
Stochastic variational inference
Matthew D Hoffman, David M Blei, Chong Wang, and John Paisley · 2013
Earlier work this paper cites.
Bayesian variable selection with shrinking and diffusing priors
Naveen Naidu Narisetty and Xuming He · 2014
Earlier work this paper cites.
Emvs: The em approach to bayesian variable selection
Veronika Ročková and Edward I George · 2014
Earlier work this paper cites.
Imagenet large scale visual recognition challenge
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael S. Bernstein, Alexander C. Berg, and Li Fei-Fei · 2015
Earlier work this paper cites.
Going deeper with convolutions
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott E. Reed, Dragomir Anguelov, D. Erhan, Vincent Vanhoucke, and Andrew Rabinovich · 2015
Earlier work this paper cites.
A weighted correlation index for rankings with ties
Sebastiano Vigna · 2015
Earlier work this paper cites.
Bayesian variable selection and estimation for group lasso
Xiaofan Xu and Malay Ghosh · 2015
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, X. Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
Deep exploration via bootstrapped dqn
Ian Osband, Charles Blundell, Alexander Pritzel, and Benjamin Van Roy · 2016
Earlier work this paper cites.
Rethinking the inception architecture for computer vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna · 2016
Earlier work this paper cites.
Yfcc100m: the new data in multimedia research
Bart Thomee, David A. Shamma, Gerald Friedland, Benjamin Elizalde, Karl S. Ni, Douglas N. Poland, Damian Borth, and Li-Jia Li · 2016
Earlier work this paper cites.
On the computational complexity of high-dimensional bayesian variable selection
Yun Yang, Martin J Wainwright, and Michael I Jordan · 2016
Earlier work this paper cites.
Variational inference: A review for statisticians
David M Blei, Alp Kucukelbir, and Jon D McAuliffe · 2017
Cited alongside, same era.
Densely connected convolutional networks
Gao Huang, Zhuang Liu, and Kilian Q. Weinberger · 2017
Cited alongside, same era.
Simple and scalable predictive uncertainty estimation using deep ensembles
Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell · 2017
Cited alongside, same era.
Deeper, broader and artier domain generalization
Da Li, Yongxin Yang, Yi-Zhe Song, and Timothy M. Hospedales · 2017
Cited alongside, same era.
Efficient variational bayesian neural network ensembles for outlier detection
Nick Pawlowski, Miguel Jaques, and Ben Glocker · 2017
Cited alongside, same era.
Deep hashing network for unsupervised domain adaptation
Hemanth Venkateswara, Jose Eusebio, Shayok Chakraborty, and Sethuraman Panchanathan · 2017
Unsupervised learning of visual features by contrasting cluster assignments
Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, and Armand Joulin · 2020
Later among the works it cites.
Improved baselines with momentum contrastive learning
Xinlei Chen, Haoqi Fan, Ross B. Girshick, and Kaiming He · 2020
Later among the works it cites.
Simulating a primary visual cortex at the front of cnns improves robustness to image perturbations
Joel Dapello, Tiago Marques, Martin Schrimpf, Franziska Geiger, David D Cox, and James J DiCarlo · 2020
Later among the works it cites.
Bootstrap your own latent: A new approach to self-supervised learning
Jean-Bastien Grill, Florian Strub, Florent Altch’e, Corentin Tallec, Pierre H. Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Ávila Pires, Zhaohan Daniel Guo, Mohammad Gheshlaghi Azar, Bilal Piot, Koray Kavukcuoglu, Rémi Munos, and Michal Valko · 2020
Later among the works it cites.
Towards non-iid image classification: A dataset and baselines
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Aggregated residual transformations for deep neural networks
Saining Xie, Ross B. Girshick, Piotr Dollár, Zhuowen Tu, and Kaiming He · 2017
Cited alongside, same era.
Bayesian model selection consistency and oracle inequality with intractable marginal likelihood
Yun Yang and Debdeep Pati · 2017
Cited alongside, same era.
Recognition in terra incognita
Sara Beery, Grant Van Horn, and Pietro Perona · 2018
Cited alongside, same era.
Deep clustering for unsupervised learning of visual features
Mathilde Caron, Piotr Bojanowski, Armand Joulin, and Matthijs Douze · 2018
Cited alongside, same era.
Stable prediction across unknown environments
Kun Kuang, Peng Cui, Susan Athey, Ruoxuan Xiong, and Bo Li · 2018
Cited alongside, same era.
Learning to generalize: Meta-learning for domain generalization
Da Li, Yongxin Yang, Yi-Zhe Song, and Timothy M Hospedales · 2018
Cited alongside, same era.
Yue He, Zheyan Shen, and Peng Cui · 2020
Later among the works it cites.
Pretrained transformers improve out-of-distribution robustness
Dan Hendrycks, Xiaoyuan Liu, Eric Wallace, Adam Dziedzic, Rishabh Krishnan, and Dawn Xiaodong Song · 2020
Later among the works it cites.
Network architecture search for domain adaptation
Yichen Li and Xingchao Peng · 2020
Later among the works it cites.
Self-supervised learning of pretext-invariant representations
Ishan Misra and Laurens van der Maaten · 2020
Later among the works it cites.
Leep: A new measure to evaluate transferability of learned representations
Cuong V Nguyen, Tal Hassner, C. Archambeau, and Matthias W. Seeger · 2020
Later among the works it cites.
Do adversarially robust imagenet models transfer better?
Hadi Salman, Andrew Ilyas, Logan Engstrom, Ashish Kapoor, and Aleksander Madry · 2020
Later among the works it cites.
Stable learning via sample reweighting
Zheyan Shen, Peng Cui, Tong Zhang, and Kun Kunag · 2020
Later among the works it cites.
Transformers: State-of-the-art natural language processing
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander M. Rush · 2020
Later among the works it cites.
Visual transformers: Token-based image representation and processing for computer vision, 2020
Bichen Wu, Chenfeng Xu, Xiaoliang Dai, Alvin Wan, Peizhao Zhang, Zhicheng Yan, Masayoshi Tomizuka, Joseph Gonzalez, Kurt Keutzer, and Peter Vajda · 2020
Later among the works it cites.
Beit: Bert pre-training of image transformers
Hangbo Bao, Li Dong, and Furu Wei · 2021
Later among the works it cites.
Swad: Domain generalization by seeking flat minima
Junbum Cha, Sanghyuk Chun, Kyungjae Lee, Han-Cheol Cho, Seunghyun Park, Yunsung Lee, and Sungrae Park · 2021
Later among the works it cites.
How well do self-supervised models transfer?
Linus Ericsson, Henry Gouk, and Timothy M Hospedales · 2021
Later among the works it cites.
In search of lost domain generalization
Ishaan Gulrajani and David Lopez-Paz · 2021
Later among the works it cites.
Natural adversarial examples
Dan Hendrycks, Kevin Zhao, Steven Basart, Jacob Steinhardt, and Dawn Song · 2021
Later among the works it cites.
Wilds: A benchmark of in-the-wild distribution shifts
Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, Richard Lanas Phillips, Irena Gao, et al · 2021
Later among the works it cites.
Out-of-distribution generalization via risk extrapolation (rex)
David Krueger, Ethan Caballero, Joern-Henrik Jacobsen, Amy Zhang, Jonathan Binas, Dinghuai Zhang, Remi Le Priol, and Aaron Courville · 2021
Later among the works it cites.
Prototypical contrastive learning of unsupervised representations
Junnan Li, Pan Zhou, Caiming Xiong, Richard Socher, and Steven C. H. Hoi · 2021
Later among the works it cites.
Swin transformer: Hierarchical vision transformer using shifted windows
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo · 2021
Later among the works it cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021
Later among the works it cites.
Zoo-tuning: Adaptive transfer from a zoo of models
Yang Shu, Zhi Kou, Zhangjie Cao, Jianmin Wang, and Mingsheng Long · 2021
Later among the works it cites.
Towards a theoretical framework of out-of-distribution generalization
Haotian Ye, Chuanlong Xie, Tianle Cai, Ruichen Li, Zhenguo Li, and Liwei Wang · 2021
Later among the works it cites.
Improved ood generalization via adversarial training and pre-training
Mingyang Yi, Lu Hou, Jiacheng Sun, Lifeng Shang, Xin Jiang, Qun Liu, and Zhi-Ming Ma · 2021
Later among the works it cites.
An empirical study of pre-trained vision models on out-of-distribution generalization
Yaodong Yu, Heinrich Jiang, Dara Bahri, Hossein Mobahi, Seungyeon Kim, Ankit Singh Rawat, Andreas Veit, and Yi Ma · 2021
Later among the works it cites.
Domain generalization with mixstyle
Kaiyang Zhou, Yongxin Yang, Yu Qiao, and Tao Xiang · 2021
Later among the works it cites.
OoD-Bench: Quantifying and understanding two dimensions of out-of-distribution generalization
Nanyang Ye, Kaican Li, Haoyue Bai, Runpeng Yu, Lanqing Hong, Fengwei Zhou, Zhenguo Li, and Jun Zhu · 2022
Closest in time.