Structured Denoising Diffusion Models in Discrete State-Spaces

Understand

Denoising diffusion probabilistic models (DDPMs) (Ho et al.

• 2020) have shown impressive results on image and waveform generation in continuous state spaces.
• Here, we introduce Discrete Denoising Diffusion Probabilistic Models (D3PMs), diffusion-like generative models for discrete data that generalize the multinomial diffusion model of Hoogeboom et al.
• 2021, by going beyond corruption processes with uniform transition probabilities.