Fetching the paper…
Reading the bibliography…
Dataset distillation methods have demonstrated remarkable performance for neural networks trained with very limited training data.
T. K. Ho, “Random decision forests,” in Proceedings of 3rd international conference on document analysis and recognition , vol. 1. IEEE, 1995, pp. 278–282
1995
Earlier work this paper cites.
L. Breiman, “Bagging predictors,” Machine learning , vol. 24, pp. 123–140, 1996
1996
Earlier work this paper cites.
L. Breiman, “Random forests,” Machine learning , vol. 45, pp. 5–32, 2001
2001
Earlier work this paper cites.
J. H. Friedman, “Stochastic gradient boosting,” Computational statistics & data analysis , vol. 38, no. 4, pp. 367–378, 2002
2002
Earlier work this paper cites.
T. Hastie, S. Rosset, J. Zhu, and H. Zou, “Multi-class adaboost,” Statistics and its Interface , vol. 2, no. 3, pp. 349–360, 2009
2009
Earlier work this paper cites.
A. Krizhevsky, G. Hinton et al. , “Learning multiple layers of features from tiny images,” 2009
2009
Earlier work this paper cites.
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition . Ieee, 2009, pp. 248–255
2009
Earlier work this paper cites.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in Neural Information Processing Systems , F. Pereira, C. Burges, L. Bottou, and K. Weinberger, Eds., vol. 25. Curran Associates, Inc., 2012. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
2012
Earlier work this paper cites.
N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: a simple way to prevent neural networks from overfitting,” The journal of machine learning research , vol. 15, no. 1, pp. 1929–1958, 2014
2014
Earlier work this paper cites.
K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint:1409.1556 , 2014
2014
Earlier work this paper cites.
G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” arXiv preprint:1503.02531 , 2015
2015
Earlier work this paper cites.
G. Larsson, M. Maire, and G. Shakhnarovich, “Fractalnet: Ultra-deep neural networks without residuals,” arXiv preprint:1605.07648 , 2016
2016
Earlier work this paper cites.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770–778
2016
Earlier work this paper cites.
G. Huang, Y. Li, G. Pleiss, Z. Liu, J. E. Hopcroft, and K. Q. Weinberger, “Snapshot ensembles: Train 1, get m for free,” arXiv preprint:1704.00109 , 2017
2017
Earlier work this paper cites.
H. Zhang, M. Cisse, Y. N. Dauphin, and D. Lopez-Paz, “mixup: Beyond empirical risk minimization,” arXiv preprint:1710.09412 , 2017
2017
Earlier work this paper cites.
T. Wang, J.-Y. Zhu, A. Torralba, and A. A. Efros, “Dataset distillation,” arXiv preprint:1811.10959 , 2018
2018
Earlier work this paper cites.
Y. Zhang, T. Xiang, T. M. Hospedales, and H. Lu, “Deep mutual learning,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2018, pp. 4320–4328
2018
Earlier work this paper cites.
Z. Yao, A. Gholami, Q. Lei, K. Keutzer, and M. W. Mahoney, “Hessian-based analysis of large batch training and robustness to adversaries,” Advances in Neural Information Processing Systems , vol. 31, 2018
2018
Earlier work this paper cites.
C. Coleman, C. Yeh, S. Mussmann, B. Mirzasoleiman, P. Bailis, P. Liang, J. Leskovec, and M. Zaharia, “Selection via proxy: Efficient data selection for deep learning,” arXiv preprint:1906.11829 , 2019
2019
Earlier work this paper cites.
C. Shorten and T. M. Khoshgoftaar, “A survey on image data augmentation for deep learning,” Journal of big data , vol. 6, no. 1, pp. 1–48, 2019
2019
Earlier work this paper cites.
S. Yun, D. Han, S. J. Oh, S. Chun, J. Choe, and Y. Yoo, “Cutmix: Regularization strategy to train strong classifiers with localizable features,” in Proceedings of the IEEE/CVF international conference on computer vision , 2019, pp. 6023–6032
2019
Earlier work this paper cites.
A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al. , “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint:2010.11929 , 2020
2020
Earlier work this paper cites.
T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020
2020
Earlier work this paper cites.
M. Hwang, Y. Jeong, and W. Sung, “Data distribution search to select core-set for machine learning,” in The 9th International Conference on Smart Media and Applications , 2020, pp. 172–176
2020
Earlier work this paper cites.
B. Zhao, K. R. Mopuri, and H. Bilen, “Dataset condensation with gradient matching,” arXiv preprint:2006.05929 , 2020
2020
Earlier work this paper cites.
G. Li, R. Togo, T. Ogawa, and M. Haseyama, “Soft-label anonymous gastric x-ray image distillation,” in 2020 IEEE International Conference on Image Processing (ICIP) . IEEE, 2020, pp. 305–309
2020
Earlier work this paper cites.
J. Goetz and A. Tewari, “Federated learning via synthetic data,” arXiv preprint:2008.04489 , 2020
2020
Earlier work this paper cites.
O. Bohdal, Y. Yang, and T. Hospedales, “Flexible dataset distillation: Learn labels instead of images,” arXiv preprint:2006.08572 , 2020
2020
Cited alongside, same era.
D. Chen, J.-P. Mei, C. Wang, Y. Feng, and C. Chen, “Online knowledge distillation with diverse peers,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 34, no. 04, 2020, pp. 3430–3437
2020
Cited alongside, same era.
S. I. Mirzadeh, M. Farajtabar, A. Li, N. Levine, A. Matsukawa, and H. Ghasemzadeh, “Improved knowledge distillation via teacher assistant,” in Proceedings of the AAAI conference on artificial intelligence , vol. 34, no. 04, 2020, pp. 5191–5198
2020
Cited alongside, same era.
C. Liu, M. Salzmann, T. Lin, R. Tomioka, and S. Süsstrunk, “On the loss landscape of adversarial training: Identifying challenges and how to overcome them,” Advances in Neural Information Processing Systems , vol. 33, pp. 21 476–21 487, 2020
2020
Cited alongside, same era.
N. Loo, R. Hasani, M. Lechner, and D. Rus, “Dataset distillation with convexified implicit gradients,” in Proceedings of the International Conference on Machine Learning (ICML) , 2023, pp. 22 649–22 674
2023
Closest in time.
J. Du, Y. Jiang, V. T. F. Tan, J. T. Zhou, and H. Li, “Minimizing the accumulated trajectory error to improve dataset distillation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2023, pp. 3749–3758
2023
Closest in time.
J. Du, Q. Shi, and J. T. Zhou, “Sequential subset matching for dataset distillation,” in Proceedings of the Advances in Neural Information Processing Systems (NeurIPS) , 2023
2023
Closest in time.
A. Sajedi, S. Khaki, E. Amjadian, L. Z. Liu, Y. A. Lawryshyn, and K. N. Plataniotis, “Datadam: Efficient dataset distillation with attention matching,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , October 2023, pp. 17 097–17 107
2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
J. Jumper, R. Evans, A. Pritzel et al. , “Highly accurate protein structure prediction with alphafold,” Nature , vol. 596, pp. 583–589, 2021. [Online]. Available: https://doi.org/10.1038/s41586-021-03819-2
2021
Cited alongside, same era.
B. Zhao and H. Bilen, “Dataset condensation with differentiable siamese augmentation,” in International Conference on Machine Learning . PMLR, 2021, pp. 12 674–12 685
2021
Cited alongside, same era.
I. Sucholutsky and M. Schonlau, “Soft-label dataset distillation and text dataset distillation,” in 2021 International Joint Conference on Neural Networks (IJCNN) . IEEE, 2021, pp. 1–8
2021
Cited alongside, same era.
T. Nguyen, Z. Chen, and J. Lee, “Dataset meta-learning from kernel ridge-regression,” in Proceedings of the International Conference on Learning Representations (ICLR) , 2021
2021
Cited alongside, same era.
T. Nguyen, R. Novak, L. Xiao, and J. Lee, “Dataset distillation with infinitely wide convolutional networks,” Advances in Neural Information Processing Systems , vol. 34, pp. 5186–5198, 2021
2021
Cited alongside, same era.
W. Chen, Z. Yu, S. De Mello, S. Liu, J. M. Alvarez, Z. Wang, and A. Anandkumar, “Contrastive syn-to-real generalization,” arXiv preprint:2104.02290 , 2021
2021
Cited alongside, same era.
S.-A. Rebuffi, S. Gowal, D. A. Calian, F. Stimberg, O. Wiles, and T. A. Mann, “Data augmentation can improve robustness,” Advances in Neural Information Processing Systems , vol. 34, pp. 29 935–29 948, 2021
2021
Cited alongside, same era.
R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-resolution image synthesis with latent diffusion models,” 2022
2022
Cited alongside, same era.
Closest in time.
G. Zhao, G. Li, Y. Qin, and Y. Yu, “Improved distribution matching for dataset condensation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2023, pp. 7856–7865
2023
Closest in time.
L. Zhang, J. Zhang, B. Lei, S. Mukherjee, X. Pan, B. Zhao, C. Ding, Y. Li, and X. Dongkuan, “Accelerating dataset distillation via model augmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2023, pp. 11 950–11 959
2023
Closest in time.
Y. Liu, J. Gu, K. Wang, Z. Zhu, W. Jiang, and Y. You, “DREAM: Efficient dataset distillation by representative matching,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , 2023, pp. 17 314–17 324
2023
Closest in time.
Y. He, L. Xiao, and T. J. Zhou, “You Only Condense Once: Two rules for pruning condensed datasets,” in Proceedings of the Advances in Neural Information Processing Systems (NeurIPS) , 2023
2023
Closest in time.
Y. Shang, Z. Yuan, and Y. Yan, “MIM4DD: Mutual information maximization for dataset distillation,” in Proceedings of the Advances in Neural Information Processing Systems (NeurIPS) , 2023
2023
Closest in time.
X. Wei, A. Cao, F. Yang, and Z. Ma, “Sparse parameterization for epitomic dataset distillation,” in Proceedings of the Advances in Neural Information Processing Systems (NeurIPS) , 2023
2023
Closest in time.
D. Shin, S. Shin, and I.-c. Moon, “Frequency domain-based dataset distillation,” in Proceedings of the Advances in Neural Information Processing Systems (NeurIPS) , 2023
2023
Closest in time.
X. Chen, C. Liang, D. Huang, E. Real, K. Wang, Y. Liu, H. Pham, X. Dong, T. Luong, C.-J. Hsieh et al. , “Symbolic discovery of optimization algorithms,” arXiv preprint:2302.06675 , 2023
2023
Closest in time.
Z. Guo, K. Wang, G. Cazenavette, H. Li, K. Zhang, and Y. You, “Towards lossless dataset distillation via difficulty-aligned trajectory matching,” in Proceedings of the International Conference on Learning Representations (ICLR) , 2024
2024
Closest in time.
Y. Lee and H. W. Chung, “SelMatch: Effectively scaling up dataset distillation via selection-based initialization and partial updates by trajectory matching,” in Proceedings of the International Conference on Machine Learning (ICML) , 2024
2024
Closest in time.
D. Liu, J. Gu, H. Cao, C. Trinitis, and M. Schulz, “Dataset distillation by automatic training trajectories,” in Proceedings of the European Conference on Computer Vision (ECCV) , 2024
2024
Closest in time.
S. Yang, S. Cheng, M. Hong, H. Fan, X. Wei, and S. Liu, “Neural spectral decomposition for dataset distillation,” in Proceedings of the European Conference on Computer Vision (ECCV) , 2024
2024
Closest in time.
H. Zhang, S. Li, P. Wang, and S. Zeng, Dan Ge, “M3D: Dataset condensation by minimizing maximum mean discrepancy,” in Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) , 2024
2024
Closest in time.
W. Deng, W. Li, T. Ding, L. Wang, H. Zhang, K. Huang, J. Huo, and Y. Gao, “Exploiting inter-sample and inter-feature relations in dataset distillation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2024, pp. 17 057–17 066
2024
Closest in time.
H. Zhang, S. Li, F. Lin, W. Wang, Z. Qian, and S. Ge, “DANCE: Dual-view distribution alignment for dataset condensation,” in Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) , 2024
2024
Closest in time.
H. Li, Y. Zhou, X. Gu, B. Li, and W. Wang, “Diversified semantic distribution matching for dataset distillation,” in Proceedings of the ACM International Conference on Multimedia (MM) , 2024
2024
Closest in time.
X. Chen, Y. Yang, Z. Wang, and B. Mirzasoleiman, “Data distillation can be like vodka: Distilling more times for better quality,” in Proceedings of the International Conference on Learning Representations (ICLR) , 2024
2024
Closest in time.
F. Yunzhen, V. Ramakrishna, and K. Julia, “Embarassingly simple dataset distillation,” in Proceedings of the International Conference on Learning Representations (ICLR) , 2024
2024
Closest in time.
Y. He, L. Xiao, J. Tianyi Zhou, and I. Tsang, “Multisize dataset condensation,” in Proceedings of the International Conference on Learning Representations (ICLR) , 2024
2024
Closest in time.
N. Loo, A. Maalouf, R. Hasani, M. Lechner, A. Amini, and D. Rus, “Large scale dataset distillation with domain shift,” in Proceedings of the International Conference on Machine Learning (ICML) , 2024
2024
Closest in time.
Y. Xu, Y.-L. Li, K. Cui, Z. Wang, C. Lu, Y.-W. Tai, and C.-K. Tang, “Distill gold from massive ores: Bi-level data pruning towards efficient dataset distillation,” in Proceedings of the European Conference on Computer Vision (ECCV) , 2024
2024
Closest in time.
H. Zheng, J. Sun, S. Wu, B. Kailkhura, Z. Mao, C. Xiao, and A. Prakash, “Leveraging hierarchical feature sharing for efficient dataset condensation,” in Proceedings of the European Conference on Computer Vision (ECCV) , 2024
2024
Closest in time.