Effectiveness of Arbitrary Transfer Sets for Data-free Knowledge Distillation

Gradient-based learning applied to document recognition

Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998

Earlier work this paper cites.

Model compression

Cristian Buciluǎ, Rich Caruana, and Alexandru Niculescu-Mizil · 2006

Earlier work this paper cites.

Learning multiple layers of features from tiny images

Alex Krizhevsky and Geoffrey Hinton · 2009

Earlier work this paper cites.

Reading digits in natural images with unsupervised feature learning, 2011

Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y Ng · 2011

Earlier work this paper cites.

Imagenet classification with deep convolutional neural networks

Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012

Earlier work this paper cites.

Distilling the knowledge in a neural network

Geoffrey Hinton, Oriol Vinyals, and Jeff Dean · 2014

Earlier work this paper cites.

Tiny imagenet visual recognition challenge

Ya Le and Xuan Yang · 2015

Earlier work this paper cites.

Deep learning face attributes in the wild

Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang · 2015

Cited alongside, same era.

An efficient algorithm for calculating the exact hausdorff distance

A. A. Taha and A. Hanbury · 2015

Cited alongside, same era.

Deep residual learning for image recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016

Cited alongside, same era.

Rethinking the inception architecture for computer vision

Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna · 2016

Cited alongside, same era.

Clevr: A diagnostic dataset for compositional language and elementary visual reasoning

Justin Johnson, Bharath Hariharan, Laurens van der Maaten, Li Fei-Fei, C Lawrence Zitnick, and Ross Girshick · 2017

Cited alongside, same era.

Data-free knowledge distillation for deep neural networks

Raphael Gontijo Lopes, Stefano Fenu, and Thad Starner · 2017

Fruit recognition from images using deep learning

Horea Mureşan and Mihai Oltean · 2018

Later among the works it cites.

Dream distillation: A data-independent model compression framework

Kartikeya Bhardwaj, Naveen Suda, and Radu Marculescu · 2019

Later among the works it cites.

Data-free learning of student networks

Hanting Chen, Yunhe Wang, Chang Xu, Zhaohui Yang, Chuanjian Liu, Boxin Shi, Chunjing Xu, Chao Xu, and Qi Tian · 2019

Later among the works it cites.

Mid-air: A multi-modal dataset for extremely low altitude drone flights

Michael Fonder and Marc Van Droogenbroeck · 2019

Later among the works it cites.

Zero-shot knowledge transfer via adversarial belief matching

Paul Micaelli and Amos J Storkey · 2019

Later among the works it cites.

Zero-shot knowledge distillation in deep networks

Gaurav Kumar Nayak, Konda Reddy Mopuri, Vaisakh Shaj, Venkatesh Babu Radhakrishnan, and Anirban Chakraborty · 2019