Fetching the paper…
Reading the bibliography…
Discrete diffusion models have recently shown significant progress in modeling complex data, such as natural languages and DNA sequences.
Fonctions de répartition à n dimensions et leurs marges
M Sklar · 1959
Earlier work this paper cites.
A relationship between arbitrary positive matrices and doubly stochastic matrices
Richard Sinkhorn · 1964
Earlier work this paper cites.
On the rate of convergence of deterministic and randomized ras matrix scaling algorithms
Bahman Kalantari and Leonid Khachiyan · 1993
Earlier work this paper cites.
Convergence of the iterative proportional fitting procedure
Ludger Ruschendorf · 1995
Earlier work this paper cites.
An introduction to copulas, 2006
Roger B Nelsen · 2006
Earlier work this paper cites.
Deep unsupervised learning using nonequilibrium thermodynamics
Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli · 2015
Earlier work this paper cites.
A review of matrix scaling and sinkhorn’s normal form for matrices and positive maps
Martin Idel · 2016
Earlier work this paper cites.
Much faster algorithms for matrix scaling
Zeyuan Allen-Zhu, Yuanzhi Li, Rafael Oliveira, and Avi Wigderson · 2017
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin · 2018
Earlier work this paper cites.
Lectures on categorical data analysis
Tamás Rudas · 2018
Earlier work this paper cites.
Openwebtext corpus
Aaron Gokaslan and Vanya Cohen · 2019
Earlier work this paper cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al · 2019
Earlier work this paper cites.
Copula modeling for discrete random vectors
Gery Geenens · 2020
Earlier work this paper cites.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020
Earlier work this paper cites.
Denoising diffusion implicit models
Jiaming Song, Chenlin Meng, and Stefano Ermon · 2020
Earlier work this paper cites.
Structured denoising diffusion models in discrete state-spaces
Jacob Austin, Daniel D Johnson, Jonathan Ho, Daniel Tarlow, and Rianne Van Den Berg · 2021
Earlier work this paper cites.
Diffusion models beat gans on image synthesis
Prafulla Dhariwal and Alex Nichol · 2021
Cited alongside, same era.
Mauve: measuring the gap between neural text and human text using divergence frontiers
Krishna Pillutla, Swabha Swayamdipta, Rowan Zellers, John Thickstun, Sean Welleck, Yejin Choi, and Zaid Harchaoui · 2021
Cited alongside, same era.
From denoising diffusions to denoising markov models
Joe Benton, Yuyang Shi, Valentin De Bortoli, George Deligiannidis, and Arnaud Doucet · 2022
Cited alongside, same era.
A continuous time framework for discrete denoising models
Andrew Campbell, Joe Benton, Valentin De Bortoli, Tom Rainforth, George Deligiannidis, and Arnaud Doucet · 2022
Cited alongside, same era.
Analog bits: Generating discrete data using diffusion models with self-conditioning
Ting Chen, Ruixiang ZHANG, and Geoffrey Hinton · 2022
Cited alongside, same era.
Conditional diffusion based on discrete graph structures for molecular graph generation
Han Huang, Leilei Sun, Bowen Du, and Weifeng Lv · 2023
Later among the works it cites.
Latent diffusion for language generation
Justin Lovelace, Varsha Kishore, Chao Wan, Eliot Shekhtman, and Kilian Q Weinberger · 2023
Later among the works it cites.
Alex Morehead, Jeffrey Ruffolo, Aadyot Bhatnagar, and Ali Madani · 2023
Later among the works it cites.
Efficiently scaling transformer inference
Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Jonathan Heek, Kefan Xiao, Shivani Agrawal, and Jeff Dean · 2023
Later among the works it cites.
Fast, accurate antibody structure prediction from deep learning on massive set of natural antibodies
Jeffrey A Ruffolo, Lee-Shin Chu, Sai Pooja Mahajan, and Jeffrey J Gray · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Sander Dieleman, Laurent Sartran, Arman Roshannai, Nikolay Savinov, Yaroslav Ganin, Pierre H Richemond, Arnaud Doucet, Robin Strudel, Chris Dyer, Conor Durkan, et al · 2022
Cited alongside, same era.
Diffusion-lm improves controllable text generation
Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang, and Tatsunori Hashimoto · 2022
Cited alongside, same era.
Concrete score matching: Generalized score matching for discrete data
Chenlin Meng, Kristy Choi, Jiaming Song, and Stefano Ermon · 2022
Cited alongside, same era.
Pointer sentinel mixture models
Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher · 2022
Cited alongside, same era.
Observed antibody space: A diverse database of cleaned, annotated, and translated unpaired and paired antibody sequences
Tobias H Olsen, Fergus Boyles, and Charlotte M Deane · 2022
Cited alongside, same era.
Self-conditioned embedding diffusion for text generation
Robin Strudel, Corentin Tallec, Florent Altché, Yilun Du, Yaroslav Ganin, Arthur Mensch, Will Grathwohl, Nikolay Savinov, Sander Dieleman, Laurent Sifre, et al · 2022
Cited alongside, same era.
Score-based continuous-time discrete diffusion models
Haoran Sun, Lijun Yu, Bo Dai, Dale Schuurmans, and Hanjun Dai · 2022
Cited alongside, same era.
Consistency models
Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever · 2023
Later among the works it cites.
Ar-diffusion: Auto-regressive diffusion model for text generation
Tong Wu, Zhihao Fan, Xiao Liu, Hai-Tao Zheng, Yeyun Gong, Jian Jiao, Juntao Li, Jian Guo, Nan Duan, Weizhu Chen, et al · 2023
Later among the works it cites.
Diffusion forcing: Next-token prediction meets full-sequence diffusion
Boyuan Chen, Diego Marti Monso, Yilun Du, Max Simchowitz, Russ Tedrake, and Vincent Sitzmann · 2024
Closest in time.
Transformers are SSMs: Generalized models and efficient algorithms through structured state space duality
Tri Dao and Albert Gu · 2024
Closest in time.
Plug-and-play controllable generation for discrete masked models
Wei Guo, Yuchen Zhu, Molei Tao, and Yongxin Chen · 2024
Closest in time.
Discrete diffusion modeling by estimating the ratios of the data distribution
Aaron Lou, Chenlin Meng, and Stefano Ermon · 2024
Closest in time.
Simple and effective masked diffusion language models
Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin, Justin T Chiu, Alexander Rush, and Volodymyr Kuleshov · 2024
Closest in time.
Simplified and generalized masked diffusion for discrete data
Jiaxin Shi, Kehang Han, Zhe Wang, Arnaud Doucet, and Michalis K. Titsias · 2024
Closest in time.
Improving and unifying discrete&continuous-time discrete denoising diffusion
Lingxiao Zhao, Xueying Ding, Lijun Yu, and Leman Akoglu · 2024
Closest in time.
Score identity distillation: Exponentially fast distillation of pretrained diffusion models for one-step generation
Mingyuan Zhou, Huangjie Zheng, Zhendong Wang, Mingzhang Yin, and Hai Huang · 2024
Closest in time.