SparseDM: Toward Sparse Efficient Diffusion Models

Y. Bengio, N. Léonard, and A. Courville, “Estimating or propagating gradients through stochastic neurons for conditional computation,” arXiv preprint arXiv:1308.3432 , 2013

Original

2013

Earlier work this paper cites.

S. Han, J. Pool, J. Tran, and W. Dally, “Learning both weights and connections for efficient neural network,” Advances in neural information processing systems , vol. 28, 2015

2015

Earlier work this paper cites.

H. Xiong, K. Wang, J. Bian, Z. Zhu, C.-Z. Xu, Z. Guo, and J. Huan, “Sphmc: Spectral hamiltonian monte carlo,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 33, no. 01, 2019, pp. 5516–5524

2019

Earlier work this paper cites.

K. Wang, X. Gao, Y. Zhao, X. Li, D. Dou, and C.-Z. Xu, “Pay attention to features, transfer learn faster cnns,” in International conference on learning representations , 2020

2020

Earlier work this paper cites.

J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” Advances in neural information processing systems , vol. 33, pp. 6840–6851, 2020

2020

Earlier work this paper cites.

J. Song, C. Meng, and S. Ermon, “Denoising diffusion implicit models,” in International Conference on Learning Representations , 2021

2021

Earlier work this paper cites.

J. Pool and C. Yu, “Channel permutations for n: M sparsity,” Advances in neural information processing systems , vol. 34, pp. 13 316–13 327, 2021

2021

Earlier work this paper cites.

A. Zhou, Y. Ma, J. Zhu, J. Liu, Z. Zhang, K. Yuan, W. Sun, and H. Li, “Learning n: M fine-grained structured sparse neural networks from scratch,” in International Conference on Learning Representations , 2021

2021

Earlier work this paper cites.

T. Hoefler, D. Alistarh, T. Ben-Nun, N. Dryden, and A. Peste, “Sparsity in deep learning: Pruning and growth for efficient inference and training in neural networks,” The Journal of Machine Learning Research , vol. 22, no. 1, pp. 10 882–11 005, 2021

2021

Earlier work this paper cites.

I. Hubara, B. Chmiel, M. Island, R. Banner, J. Naor, and D. Soudry, “Accelerated sparse neural training: A provable and efficient method to find n: m transposable masks,” Advances in neural information processing systems , vol. 34, pp. 21 099–21 111, 2021

2021

Earlier work this paper cites.

K. Wang, H. Xiong, J. Bian, Z. Zhu, Q. Gao, Z. Guo, C.-Z. Xu, J. Huan, and D. Dou, “Sampling sparse representations with randomized measurement langevin dynamics,” ACM Transactions on Knowledge Discovery from Data (TKDD) , vol. 15, no. 2, pp. 1–21, 2021

2021

Cited alongside, same era.

K. Wang, H. Xiong, J. Zhang, H. Chen, D. Dou, and C.-Z. Xu, “Sensemag: Enabling low-cost traffic monitoring using noninvasive magnetic sensing,” IEEE Internet of Things Journal , vol. 8, no. 22, pp. 16 666–16 679, 2021

2021

Cited alongside, same era.

T. Karras, M. Aittala, T. Aila, and S. Laine, “Elucidating the design space of diffusion-based generative models,” Advances in Neural Information Processing Systems , vol. 35, pp. 26 565–26 577, 2022

2022

Cited alongside, same era.

F. Bao, C. Li, J. Zhu, and B. Zhang, “Analytic-dpm: an analytic estimate of the optimal reverse variance in diffusion probabilistic models,” in International Conference on Learning Representations , 2022

2022

G. Fang, X. Ma, and X. Wang, “Structural pruning for diffusion models,” NeurIPS , 2023

2023

Later among the works it cites.

F. Bao, S. Nie, K. Xue, Y. Cao, C. Li, H. Su, and J. Zhu, “All are worth words: A vit backbone for diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 22 669–22 679

2023

Later among the works it cites.

W. Peebles and S. Xie, “Scalable diffusion models with transformers,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 4195–4205

2023

Later among the works it cites.

K. Wang, P. Wang, and C. Xu, “Toward efficient automated feature engineering,” in 2023 IEEE 39th International Conference on Data Engineering (ICDE) . IEEE, 2023, pp. 1625–1637

2023

Later among the works it cites.