Fetching the paper…
Reading the bibliography…
Though vision transformers (ViTs) have exhibited impressive ability for representation learning, we empirically find that they cannot generalize well to unseen domains with previous domain generalization algorithms.
“ImageNet: A large-scale hierarchical image database”
Jia Deng et al · 2009
Earlier work this paper cites.
“ImageNet classification with deep convolutional neural networks”
Alex Krizhevsky, Ilya Sutskever and Geoffrey. Hinton · 2012
Earlier work this paper cites.
“Unbiased Metric Learning: On the Utilization of Multiple Datasets and Web Images for Softening Bias”
Chen Fang, Ye Xu and Daniel. Rockmore · 2013
Earlier work this paper cites.
“Adam: A Method for Stochastic Optimization”
Diederik. Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
“Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks”
Alec Radford, Luke Metz and Soumith Chintala · 2015
Earlier work this paper cites.
“Domain Separation Networks”
Konstantinos Bousmalis et al · 2016
Earlier work this paper cites.
“Domain-Adversarial Training of Neural Networks”
Yaroslav Ganin et al · 2016
Earlier work this paper cites.
“Scatter component analysis: A unified framework for domain adaptation and domain generalization”
Muhammad Ghifary, David Balduzzi, W Kleijn and Mengjie Zhang · 2016
Earlier work this paper cites.
“Deep Residual Learning for Image Recognition”
Kaiming He, X. Zhang, Shaoqing Ren and Jian Sun · 2016
Earlier work this paper cites.
“Deep Networks with Stochastic Depth”
Gao Huang et al · 2016
Earlier work this paper cites.
“You Only Look Once: Unified, Real-Time Object Detection”
Joseph Redmon, Santosh Divvala, Ross. Girshick and Ali Farhadi · 2016
Earlier work this paper cites.
“Deep CORAL: Correlation Alignment for Deep Domain Adaptation”
Baochen Sun and Kate Saenko · 2016
Earlier work this paper cites.
“Matching networks for one shot learning”
Oriol Vinyals, Charles Blundell, Timothy Lillicrap and Daan Wierstra · 2016
Earlier work this paper cites.
“Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks”
Chelsea Finn, P. Abbeel and Sergey Levine · 2017
Earlier work this paper cites.
“Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization”
Xun Huang and Serge. Belongie · 2017
Earlier work this paper cites.
“Deeper, Broader and Artier Domain Generalization”
Da Li, Yongxin Yang, Yi-Zhe Song and Timothy. Hospedales · 2017
Earlier work this paper cites.
“Unified deep supervised domain adaptation and generalization”
Saeid Motiian, Marco Piccirilli, Donald Adjeroh and Gianfranco Doretto · 2017
Cited alongside, same era.
“Fully Convolutional Networks for Semantic Segmentation”
Evan Shelhamer, Jonathan Long and Trevor Darrell · 2017
Cited alongside, same era.
“Deep Hashing Network for Unsupervised Domain Adaptation”
Hemanth Venkateswara, Jose Eusebio, Shayok Chakraborty and Sethuraman Panchanathan · 2017
Cited alongside, same era.
“MetaReg: Towards Domain Generalization using Meta-Regularization”
Yogesh Balaji, Swami Sankaranarayanan and Rama Chellappa · 2018
Cited alongside, same era.
“Deep Domain Generalization With Structured Low-Rank Constraint”
Zhengming Ding and Yun Fu · 2018
Cited alongside, same era.
“Learning to Generalize: Meta-Learning for Domain Generalization”
“Heterogeneous Domain Generalization Via Domain Mixup”
Yufei Wang, Haoliang Li and Alex Kot · 2020
Later among the works it cites.
“Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalization”
Devansh Arpit, Huan Wang, Yingbo Zhou and Caiming Xiong · 2021
Later among the works it cites.
“Rethinking Domain Generalization Baselines”
Francesco Borlino, Antonio D’Innocente and Tatiana Tommasi · 2021
Later among the works it cites.
“SWAD: Domain Generalization by Seeking Flat Minima”
Junbum Cha et al · 2021
Later among the works it cites.
“An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale”
Alexey Dosovitskiy et al · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Da Li, Yongxin Yang, Yi-Zhe Song and Timothy. Hospedales · 2018
Cited alongside, same era.
“Domain Generalization with Adversarial Feature Learning”
Haoliang Li, Sinno Pan, Shiqi Wang and Alex Kot · 2018
Cited alongside, same era.
“Deep Domain Generalization via Conditional Invariant Adversarial Networks”
Ya Li et al · 2018
Cited alongside, same era.
Martín Arjovsky, Léon Bottou, Ishaan Gulrajani and David Lopez-Paz · 2019
Cited alongside, same era.
“Domain Generalization by Solving Jigsaw Puzzles”
Fabio Carlucci et al · 2019
Cited alongside, same era.
“Decoupled Weight Decay Regularization”
Ilya Loshchilov and Frank Hutter · 2019
Cited alongside, same era.
“PyTorch: An Imperative Style, High-Performance Deep Learning Library”
Adam Paszke et al · 2019
Cited alongside, same era.
Ishaan Gulrajani and David Lopez-Paz · 2021
Later among the works it cites.
“P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks”
Xiao Liu et al · 2021
Later among the works it cites.
“Swin Transformer: Hierarchical Vision Transformer using Shifted Windows”
Ze Liu et al · 2021
Later among the works it cites.
“Reducing Domain Gap by Reducing Style Bias”
Hyeonseob Nam et al · 2021
Later among the works it cites.
“Intriguing Properties of Vision Transformers”
Muzammal Naseer et al · 2021
Later among the works it cites.
“Do Vision Transformers See Like Convolutional Neural Networks?”
Maithra Raghu et al · 2021
Later among the works it cites.
“Domain generalization in vision: A survey”
Kaiyang Zhou et al · 2021
Later among the works it cites.
“Learning to Prompt for Vision-Language Models”
Kaiyang Zhou, Jingkang Yang, Chen Loy and Ziwei Liu · 2021
Later among the works it cites.
“Domain Adaptive Ensemble Learning”
Kaiyang Zhou, Yongxin Yang, Yu Qiao and Tao Xiang · 2021
Later among the works it cites.
“Domain Adaptation via Prompt Learning”
Chunjiang Ge et al · 2022
Closest in time.
“Delving deep into the generalization of vision transformers under distribution shifts”
Chongzhi Zhang et al · 2022
Closest in time.