VQ4DiT: Efficient Post-Training Vector Quantization for Diffusion Transformers

And the bit goes down: Revisiting the quantization of neural networks

Original

Stock, P.; Joulin, A.; Gribonval, R.; Graham, B.; and Jégou, H. 2019 · 1907

Earlier work this paper cites.

Vector quantization and signal compression , volume 159

Gersho, A.; and Gray, R. M. 2012 · 2012

Earlier work this paper cites.

Very deep convolutional networks for large-scale image recognition

Original

Simonyan, K.; and Zisserman, A. 2014 · 2014

Earlier work this paper cites.

Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding

Original

Han, S.; Mao, H.; and Dally, W. J. 2015 · 2015

Earlier work this paper cites.

Imagenet large scale visual recognition challenge

Russakovsky, O.; Deng, J.; Su, H.; Krause, J.; Satheesh, S.; Ma, S.; Huang, Z.; Karpathy, A.; Khosla, A.; Bernstein, M.; et al. 2015 · 2015

Earlier work this paper cites.

Layer normalization

Original

Ba, J. L.; Kiros, J. R.; and Hinton, G. E. 2016 · 2016

Earlier work this paper cites.

Deep residual learning for image recognition

He, K.; Zhang, X.; Ren, S.; and Sun, J. 2016 · 2016

Earlier work this paper cites.

Improved techniques for training gans

Salimans, T.; Goodfellow, I.; Zaremba, W.; Cheung, V.; Radford, A.; and Chen, X. 2016 · 2016

Earlier work this paper cites.

Gans trained by a two time-scale update rule converge to a local nash equilibrium

Heusel, M.; Ramsauer, H.; Unterthiner, T.; Nessler, B.; and Hochreiter, S. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, L.; and Polosukhin, I. 2017 · 2017

Earlier work this paper cites.

A note on the inception score

Original

Barratt, S.; and Sharma, R. 2018 · 2018

Earlier work this paper cites.

Film: Visual reasoning with a general conditioning layer

Perez, E.; Strub, F.; De Vries, H.; Dumoulin, V.; and Courville, A. 2018 · 2018

Earlier work this paper cites.

End-to-end object detection with transformers

Carion, N.; Massa, F.; Synnaeve, G.; Usunier, N.; Kirillov, A.; and Zagoruyko, S. 2020 · 2020

Earlier work this paper cites.

Denoising diffusion probabilistic models

Ho, J.; Jain, A.; and Abbeel, P. 2020 · 2020

Cited alongside, same era.

Diffusion models beat gans on image synthesis

Dhariwal, P.; and Nichol, A. 2021 · 2021

Cited alongside, same era.

An image is worth 16x16 words: Transformers for image recognition at scale

Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; et al. 2021 · 2021

Cited alongside, same era.

Swin transformer: Hierarchical vision transformer using shifted windows

Liu, Z.; Lin, Y.; Cao, Y.; Hu, H.; Wei, Y.; Zhang, Z.; Lin, S.; and Guo, B. 2021 · 2021

Cited alongside, same era.

Permute, quantize, and fine-tune: Efficient compression of neural networks

Martinez, J.; Shewakramani, J.; Liu, T. W.; Bârsan, I. A.; Zeng, W.; and Urtasun, R. 2021 · 2021

Cited alongside, same era.

Generating images with sparse representations

Ptq4vit: Post-training quantization for vision transformers with twin uniform quantization

Yuan, Z.; Xue, C.; Chen, Y.; Wu, Q.; and Sun, G. 2022 · 2022

Later among the works it cites.

Diffusion models in vision: A survey

Croitoru, F.-A.; Hondru, V.; Ionescu, R. T.; and Shah, M. 2023 · 2023

Later among the works it cites.

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Original

Lin, J.; Tang, J.; Tang, H.; Yang, S.; Dang, X.; and Han, S. 2023 · 2023

Later among the works it cites.

Scalable diffusion models with transformers

Peebles, W.; and Xie, S. 2023 · 2023

Later among the works it cites.

Diffusion models: A comprehensive survey of methods and applications

Yang, L.; Zhang, Z.; Song, Y.; Hong, S.; Xu, R.; Zhao, Y.; Zhang, W.; Cui, B.; and Yang, M.-H. 2023 · 2023

Later among the works it cites.