Fetching the paper…
Reading the bibliography…
We demonstrate that a deep model can be reparametrized as a linear combination of several randomly initialized and frozen deep models in the weight space.
Kodak Dataset
Kodak · 1991
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Compressing neural networks with the hashing trick
Wenlin Chen, James Wilson, Stephen Tyree, Kilian Weinberger, and Yixin Chen · 2015
Earlier work this paper cites.
Song Han, Huizi Mao, and William J Dally · 2015
Earlier work this paper cites.
Distilling the knowledge in a neural network
Geoffrey Hinton, Oriol Vinyals, Jeff Dean, et al · 2015
Earlier work this paper cites.
Lenet-5, convolutional neural networks
Yann LeCun et al · 2015
Earlier work this paper cites.
Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton · 2016
Earlier work this paper cites.
Xnor-net: Imagenet classification using binary convolutional neural networks
Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, and Ali Farhadi · 2016
Earlier work this paper cites.
Lcnn: Lookup-based convolutional neural network
Hessam Bagherinezhad, Mohammad Rastegari, and Ali Farhadi · 2017
Earlier work this paper cites.
Soft weight-sharing for neural network compression
Karen Ullrich, Edward Meeds, and Max Welling · 2017
Earlier work this paper cites.
Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases
Xiaosong Wang, Yifan Peng, Le Lu, Zhiyong Lu, Mohammadhadi Bagheri, and Ronald M Summers · 2017
Earlier work this paper cites.
Variational image compression with a scale hyperprior
Johannes Ballé, David Minnen, Saurabh Singh, Sung Jin Hwang, and Nick Johnston · 2018
Earlier work this paper cites.
Minimal random code learning: Getting bits back from compressed model parameters
Marton Havasi, Robert Peharz, and José Miguel Hernández-Lobato · 2018
Earlier work this paper cites.
Context-adaptive entropy model for end-to-end optimized image compression
Jooyoung Lee, Seunghyun Cho, and Seung-Kwon Beack · 2018
Earlier work this paper cites.
Joint autoregressive and hierarchical priors for learned image compression
David Minnen, Johannes Ballé, and George D Toderici · 2018
Earlier work this paper cites.
Weightless: Lossy weight encoding for deep neural network compression
Brandon Reagan, Udit Gupta, Bob Adolf, Michael Mitzenmacher, Alexander Rush, Gu-Yeon Wei, and David Brooks · 2018
Earlier work this paper cites.
Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba, and Alexei A Efros · 2018
Earlier work this paper cites.
Content adaptive optimization for neural image compression
JCMSA Djelouah and Christopher Schroers · 2019
Earlier work this paper cites.
The role of over-parametrization in generalization of neural networks
Behnam Neyshabur, Zhiyuan Li, Srinadh Bhojanapalli, Yann LeCun, and Nathan Srebro · 2019
Cited alongside, same era.
On the loss landscape of a class of deep neural networks with no bad local valleys
Quynh Nguyen, Mahesh Chandra Mukkamala, and Matthias Hein · 2019
Cited alongside, same era.
Flexible dataset distillation: Learn labels instead of images
Ondrej Bohdal, Yongxin Yang, and Timothy Hospedales · 2020
Cited alongside, same era.
Rigging the lottery: Making all tickets winners
Utku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro, and Erich Elsen · 2020
Cited alongside, same era.
Deep randomized neural networks
Claudio Gallicchio and Simone Scardapane · 2020
Cited alongside, same era.
Variable rate image compression with content adaptive optimization
Supermasks in superposition
Mitchell Wortsman, Vivek Ramanujan, Rosanne Liu, Aniruddha Kembhavi, Mohammad Rastegari, Jason Yosinski, and Ali Farhadi · 2020
Later among the works it cites.
Dataset condensation with gradient matching
Bo Zhao, Konda Reddy Mopuri, and Hakan Bilen · 2020
Later among the works it cites.
Peek-a-boo: What (more) is disguised in a randomly weighted neural network, and how to find it efficiently
Xiaohan Chen, Jason Zhang, and Zhangyang Wang · 2021
Later among the works it cites.
Global minima of overparameterized neural networks
Yaim Cooper · 2021
Later among the works it cites.
Coin: Compression with implicit neural representations
Emilien Dupont, Adam Goliński, Milad Alizadeh, Yee Whye Teh, and Arnaud Doucet · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Tiansheng Guo, Jing Wang, Ze Cui, Yihui Feng, Yunying Ge, and Bo Bai · 2020
Cited alongside, same era.
Ghostnet: More features from cheap operations
Kai Han, Yunhe Wang, Qi Tian, Jianyuan Guo, Chunjing Xu, and Chang Xu · 2020
Cited alongside, same era.
Robust pruning at initialization
Soufiane Hayou, Jean-Francois Ton, Arnaud Doucet, and Yee Whye Teh · 2020
Cited alongside, same era.
Neuron merging: Compensating for pruned neurons
Woojeong Kim, Suhyun Kim, Mincheol Park, and Geunseok Jeon · 2020
Cited alongside, same era.
Soft threshold weight reparameterization for learnable sparsity
Aditya Kusupati, Vivek Ramanujan, Raghav Somani, Mitchell Wortsman, Prateek Jain, Sham Kakade, and Ali Farhadi · 2020
Cited alongside, same era.
Layer-adaptive sparsity for the magnitude-based pruning
Jaeho Lee, Sejun Park, Sangwoo Mo, Sungsoo Ahn, and Jinwoo Shin · 2020
Cited alongside, same era.
Dynamic model pruning with feedback
Tao Lin, Sebastian U Stich, Luis Barba, Daniil Dmitriev, and Martin Jaggi · 2020
Cited alongside, same era.
Network quantization with element-wise gradient scaling
Junghyup Lee, Dohyung Kim, and Bumsub Ham · 2021
Later among the works it cites.
Towards compact cnns via collaborative compression
Yuchao Li, Shaohui Lin, Jianzhuang Liu, Qixiang Ye, Mengdi Wang, Fei Chao, Fan Yang, Jincheng Ma, Qi Tian, and Rongrong Ji · 2021
Later among the works it cites.
Dynamic pruning of a neural network via gradient signal-to-noise ratio
Julien Niklas Siems, Aaron Klein, Cedric Archambeau, and Maren Mahsereci · 2021
Later among the works it cites.
Soft-label dataset distillation and text dataset distillation
Ilia Sucholutsky and Matthias Schonlau · 2021
Later among the works it cites.
Chipnet: Budget-aware pruning with heaviside continuous approximations
Rishabh Tiwari, Udbhav Bamba, Arnav Chavan, and Deepak K Gupta · 2021
Later among the works it cites.
Dataset condensation with differentiable siamese augmentation
Bo Zhao and Hakan Bilen · 2021
Later among the works it cites.
Dataset condensation with distribution matching
Bo Zhao and Hakan Bilen · 2021
Later among the works it cites.
Dataset distillation by matching training trajectories
George Cazenavette, Tongzhou Wang, Antonio Torralba, Alexei A Efros, and Jun-Yan Zhu · 2022
Closest in time.
An information-theoretic justification for model pruning
Berivan Isik, Tsachy Weissman, and Albert No · 2022
Closest in time.
Loss landscapes and optimization in over-parameterized non-linear systems and neural networks
Chaoyue Liu, Libin Zhu, and Mikhail Belkin · 2022
Closest in time.
Weight fixing networks
Christopher Subia-Waud and Srinandan Dasmahapatra · 2022
Closest in time.
Cafe: Learning to condense dataset by aligning features
Kai Wang, Bo Zhao, Xiangyu Peng, Zheng Zhu, Shuo Yang, Shuo Wang, Guan Huang, Hakan Bilen, Xinchao Wang, and Yang You · 2022
Closest in time.