Fetching the paper…

Reading the bibliography…

2023

The Hidden Linear Structure in Score-Based Models and its Application

Wang, Binxu, Vastola, John J.

Original
PDF
Post on X

Understand

Score-based models have achieved remarkable results in the generative modeling of many domains.

By learning the gradient of smoothed data distribution, they can iteratively generate samples from complex distribution e.g.
natural images.
However, is there any universal structure in the gradient field that will eventually be learned by any neural network? Here, we aim to find such structures through a normative analysis of the score function.

The Hidden Linear Structure in Score-Based Models and its Application · Around

Built on

Inverting modified matrices
Woodbury, M. A. (1950) · 1950
Earlier work this paper cites.
Introduction to electrodynamics
Griffiths, D. J. (2005) · 2005
Earlier work this paper cites.
Denoising diffusion implicit models
Original
Song, J., Meng, C., and Ermon, S. (2020) · 2010
Earlier work this paper cites.
Stargan v2: Diverse image synthesis for multiple domains
Choi, Y., Uh, Y., Yoo, J., and Ha, J.-W. (2020) · 2020
Earlier work this paper cites.

Similar

Denoising diffusion probabilistic models
Ho, J., Jain, A., and Abbeel, P. (2020) · 2020
Cited alongside, same era.
Score-based generative modeling through stochastic differential equations
Song, Y., Sohl-Dickstein, J., Kingma, D. P., Kumar, A., Ermon, S., and Poole, B. (2021) · 2021
Cited alongside, same era.
Elucidating the design space of diffusion-based generative models
Original
Karras, T., Aittala, M., Aila, T., and Laine, S. (2022) · 2022
Cited alongside, same era.
Pseudo numerical methods for diffusion models on manifolds
Original
Liu, L., Ren, Y., Lin, Z., and Zhao, Z. (2022) · 2022
Cited alongside, same era.

Then

High-resolution image synthesis with latent diffusion models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., and Ommer, B. (2022) · 2022
Later among the works it cites.
Generalization in diffusion models arises from geometry-adaptive harmonic representation
Original
Kadkhodaie, Z., Guth, F., Simoncelli, E. P., and Mallat, S. (2023) · 2023
Closest in time.
Closed-form diffusion models
Original
Scarvelis, C., Borde, H. S. d. O., and Solomon, J. (2023) · 2023
Closest in time.
Diffusion models generate images like painters: an analytical theory of outline first, details later
Original
Wang, B. and Vastola, J. J. (2023) · 2023
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…