Fetching the paper…
Reading the bibliography…
The dimensionality of the embedding and the number of available embeddings ( also called codebook size) are critical factors influencing the performance of Vector Quantization(VQ), a discretization process used in many models such as the Vector Quantized Variational Autoencoder (VQ-VAE) architecture.
Some methods for classification and analysis of multivariate observations
James MacQueen et al · 1967
Earlier work this paper cites.
Vector quantization
Robert Gray · 1984
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Estimating or propagating gradients through stochastic neurons for conditional computation
Yoshua Bengio, Nicholas Léonard, and Aaron Courville · 2013
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P Kingma and Max Welling · 2013
Earlier work this paper cites.
Going deeper with convolutions
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich · 2015
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
Neural discrete representation learning
Aaron Van Den Oord, Oriol Vinyals, et al · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Fast decoding in sequence models using discrete latent variables
Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, and Noam Shazeer · 2018
Earlier work this paper cites.
Theory and experiments on vector quantized autoencoders
Aurko Roy, Ashish Vaswani, Arvind Neelakantan, and Niki Parmar · 2018
Earlier work this paper cites.
Generating diverse high-fidelity images with vq-vae-2
Ali Razavi, Aaron Van den Oord, and Oriol Vinyals · 2019
Cited alongside, same era.
Jukebox: A generative model for music
Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, and Ilya Sutskever · 2020
Cited alongside, same era.
Robust training of vector quantized bottleneck models
Adrian Łańcucki, Jan Chorowski, Guillaume Sanchez, Ricard Marxer, Nanxin Chen, Hans JGA Dolfing, Sameer Khurana, Tanel Alumäe, and Antoine Laurent · 2020
Cited alongside, same era.
Discrete-valued neural communication
Dianbo Liu, Alex M Lamb, Kenji Kawaguchi, Anirudh Goyal ALIAS PARTH GOYAL, Chen Sun, Michael C Mozer, and Yoshua Bengio · 2021
Cited alongside, same era.
Soundstream: An end-to-end neural audio codec
Neil Zeghidour, Alejandro Luebs, Ahmed Omran, Jan Skoglund, and Marco Tagliasacchi · 2021
Cited alongside, same era.
Edvae: Mitigating codebook collapse with evidential discrete variational autoencoders
Gulcin Baykal, Melih Kandemir, and Gozde Unal · 2023
Later among the works it cites.
Soft convex quantization: Revisiting vector quantization with convex optimization
Tanmay Gautam, Reid Pryzant, Ziyi Yang, Chenguang Zhu, and Somayeh Sojoudi · 2023
Later among the works it cites.
Straightening out the straight-through estimator: Overcoming optimization challenges in vector quantized networks
Minyoung Huh, Brian Cheung, Pulkit Agrawal, and Phillip Isola · 2023
Later among the works it cites.
Resizing codebook of vector quantization without retraining
Lei Li, Tingting Liu, Chengyu Wang, Minghui Qiu, Cen Chen, Ming Gao, and Aoying Zhou · 2023
Later among the works it cites.
Finite scalar quantization: Vq-vae made simple
Fabian Mentzer, David Minnen, Eirikur Agustsson, and Michael Tschannen · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Doyup Lee, Chiheon Kim, Saehoon Kim, Minsu Cho, and Wook-Shin Han · 2022
Cited alongside, same era.
Adaptive discrete communication bottlenecks with dynamic vector quantization
Dianbo Liu, Alex Lamb, Xu Ji, Pascal Notsawo, Mike Mozer, Yoshua Bengio, and Kenji Kawaguchi · 2022
Cited alongside, same era.
Adaptive bitrate quantization scheme without codebook for learned image compression
Jonas Löhdefink, Jonas Sitzmann, Andreas Bär, and Tim Fingscheidt · 2022
Cited alongside, same era.
Sq-vae: Variational bayes on discrete representation with self-annealed stochastic quantization
Yuhta Takida, Takashi Shibuya, WeiHsiang Liao, Chieh-Hsin Lai, Junki Ohmura, Toshimitsu Uesaka, Naoki Murata, Shusuke Takahashi, Toshiyuki Kumakura, and Yuki Mitsufuji · 2022
Cited alongside, same era.
Variable rate allocation for vector-quantized autoencoders
Federico Baldassarre, Alaaeldin El-Nouby, and Hervé Jégou · 2023
Cited alongside, same era.
Later among the works it cites.
Hq-vae: Hierarchical discrete representation learning with variational bayes
Yuhta Takida, Yukara Ikemiya, Takashi Shibuya, Kazuki Shimada, Woosung Choi, Chieh-Hsin Lai, Naoki Murata, Toshimitsu Uesaka, Kengo Uchida, Wei-Hsiang Liao, et al · 2023
Later among the works it cites.
Language model beats diffusion–tokenizer is key to visual generation
Lijun Yu, José Lezama, Nitesh B Gundavarapu, Luca Versari, Kihyuk Sohn, David Minnen, Yong Cheng, Agrim Gupta, Xiuye Gu, Alexander G Hauptmann, et al · 2023
Later among the works it cites.
Online clustered codebook
Chuanxia Zheng and Andrea Vedaldi · 2023
Later among the works it cites.
Hypervq: Mlr-based vector quantization in hyperbolic space
Nabarun Goswami, Yusuke Mukuta, and Tatsuya Harada · 2024
Closest in time.
Residual quantization with implicit neural codebooks
Iris Huijben, Matthijs Douze, Matthew Muckley, Ruud van Sloun, and Jakob Verbeek · 2024
Closest in time.