Fetching the paper…
Reading the bibliography…
In this paper, we propose an efficient, fast, and versatile distillation method to accelerate the generation of pre-trained diffusion models: Flash Diffusion.
A connection between score matching and denoising autoencoders
Vincent, P. 2011 · 2011
Earlier work this paper cites.
Generative adversarial nets
Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; and Bengio, Y. 2014 · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Kingma, D. P.; and Ba, J. 2014 · 2014
Earlier work this paper cites.
Microsoft coco: Common objects in context
Lin, T.-Y.; Maire, M.; Belongie, S.; Hays, J.; Perona, P.; Ramanan, D.; Dollár, P.; and Zitnick, C. L. 2014 · 2014
Earlier work this paper cites.
Training generative neural networks via maximum mean discrepancy optimization
Dziugaite, G. K.; Roy, D. M.; and Ghahramani, Z. 2015 · 2015
Earlier work this paper cites.
Distilling the knowledge in a neural network
Hinton, G.; Vinyals, O.; and Dean, J. 2015 · 2015
Earlier work this paper cites.
Generative moment matching networks
Li, Y.; Swersky, K.; and Zemel, R. 2015 · 2015
Earlier work this paper cites.
U-net: Convolutional networks for biomedical image segmentation
Ronneberger, O.; Fischer, P.; and Brox, T. 2015 · 2015
Earlier work this paper cites.
Deep unsupervised learning using nonequilibrium thermodynamics
Sohl-Dickstein, J.; Weiss, E.; Maheswaranathan, N.; and Ganguli, S. 2015 · 2015
Earlier work this paper cites.
Gaussian error linear units (gelus)
Hendrycks, D.; and Gimpel, K. 2016 · 2016
Earlier work this paper cites.
Wasserstein generative adversarial networks
Arjovsky, M.; Chintala, S.; and Bottou, L. 2017 · 2017
Earlier work this paper cites.
Gans trained by a two time-scale update rule converge to a local nash equilibrium
Heusel, M.; Ramsauer, H.; Unterthiner, T.; Nessler, B.; and Hochreiter, S. 2017 · 2017
Earlier work this paper cites.
Lim, J. H.; and Ye, J. C. 2017 · 2017
Earlier work this paper cites.
Least squares generative adversarial networks
Mao, X.; Li, Q.; Xie, H.; Lau, R. Y.; Wang, Z.; and Paul Smolley, S. 2017 · 2017
Earlier work this paper cites.
Searching for activation functions
Ramachandran, P.; Zoph, B.; and Le, Q. V. 2017 · 2017
Earlier work this paper cites.
Neural ordinary differential equations
Chen, R. T.; Rubanova, Y.; Bettencourt, J.; and Duvenaud, D. K. 2018 · 2018
Earlier work this paper cites.
Group normalization
Wu, Y.; and He, K. 2018 · 2018
Earlier work this paper cites.
The unreasonable effectiveness of deep features as a perceptual metric
Zhang, R.; Isola, P.; Efros, A. A.; Shechtman, E.; and Wang, O. 2018 · 2018
Earlier work this paper cites.
Generative modeling by estimating gradients of the data distribution
Song, Y.; and Ermon, S. 2019 · 2019
Earlier work this paper cites.
Denoising diffusion probabilistic models
Ho, J.; Jain, A.; and Abbeel, P. 2020 · 2020
Earlier work this paper cites.
Score-Based Generative Modeling through Stochastic Differential Equations
Song, Y.; Sohl-Dickstein, J.; Kingma, D. P.; Kumar, A.; Ermon, S.; and Poole, B. 2020 · 2020
Earlier work this paper cites.
Diffusion models beat gans on image synthesis
Dhariwal, P.; and Nichol, A. 2021 · 2021
Earlier work this paper cites.
Classifier-Free Diffusion Guidance
Ho, J.; and Salimans, T. 2021 · 2021
Earlier work this paper cites.
LoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J.; Wallis, P.; Allen-Zhu, Z.; Li, Y.; Wang, S.; Wang, L.; Chen, W.; et al. 2021 · 2021
Cited alongside, same era.
OpenCLIP
Ilharco, G.; Wortsman, M.; Carlini, N.; Taori, R.; Dave, A.; Shankar, V.; Namkoong, H.; Miller, J.; Hajishirzi, H.; Farhadi, A.; and Schmidt, L. 2021 · 2021
Cited alongside, same era.
Variational diffusion models
Kingma, D.; Salimans, T.; Poole, B.; and Ho, J. 2021 · 2021
Cited alongside, same era.
Knowledge distillation in iterative generative models for improved sampling speed
Luhman, E.; and Luhman, T. 2021 · 2021
Cited alongside, same era.
Learning transferable visual models from natural language supervision
Radford, A.; Kim, J. W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; et al. 2021 · 2021
Cited alongside, same era.
Zero-shot text-to-image generation
SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis
Podell, D.; English, Z.; Lacey, K.; Blattmann, A.; Dockhorn, T.; Müller, J.; Penna, J.; and Rombach, R. 2023 · 2023
Later among the works it cites.
Adversarial diffusion distillation
Sauer, A.; Lorenz, D.; Blattmann, A.; and Rombach, R. 2023 · 2023
Later among the works it cites.
Improved Techniques for Training Consistency Models
Song, Y.; and Dhariwal, P. 2023 · 2023
Later among the works it cites.
Consistency models
Song, Y.; Dhariwal, P.; Chen, M.; and Sutskever, I. 2023 · 2023
Later among the works it cites.
Diffusion model alignment using direct preference optimization
Wallace, B.; Dang, M.; Rafailov, R.; Zhou, L.; Lou, A.; Purushwalkam, S.; Ermon, S.; Xiong, C.; Joty, S.; and Naik, N. 2023 · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ramesh, A.; Pavlov, M.; Goh, G.; Gray, S.; Voss, C.; Radford, A.; Chen, M.; and Sutskever, I. 2021 · 2021
Cited alongside, same era.
Progressive Distillation for Fast Sampling of Diffusion Models
Salimans, T.; and Ho, J. 2021 · 2021
Cited alongside, same era.
Imagen video: High definition video generation with diffusion models
Ho, J.; Chan, W.; Saharia, C.; Whang, J.; Gao, R.; Gritsenko, A.; Kingma, D. P.; Poole, B.; Norouzi, M.; Fleet, D. J.; et al. 2022 · 2022
Cited alongside, same era.
Elucidating the design space of diffusion-based generative models
Karras, T.; Aittala, M.; Aila, T.; and Laine, S. 2022 · 2022
Cited alongside, same era.
Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
Liu, X.; Gong, C.; et al. 2022 · 2022
Cited alongside, same era.
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
Nichol, A. Q.; Dhariwal, P.; Ramesh, A.; Shyam, P.; Mishkin, P.; Mcgrew, B.; Sutskever, I.; and Chen, M. 2022 · 2022
Cited alongside, same era.
On aliased resizing and surprising subtleties in gan evaluation
Parmar, G.; Zhang, R.; and Zhu, J.-Y. 2022 · 2022
Cited alongside, same era.
Wang, W.; Lv, Q.; Yu, W.; Hong, W.; Qi, J.; Wang, Y.; Ji, J.; Yang, Z.; Zhao, L.; Song, X.; et al. 2023 · 2023
Later among the works it cites.
Ufogen: You forward once large scale text-to-image generation via diffusion gans
Xu, Y.; Zhao, Y.; Xiao, Z.; and Hou, T. 2023 · 2023
Later among the works it cites.
One-step diffusion with distribution matching distillation
Yin, T.; Gharbi, M.; Zhang, R.; Shechtman, E.; Durand, F.; Freeman, W. T.; and Park, T. 2023 · 2023
Later among the works it cites.
Adding conditional control to text-to-image diffusion models
Zhang, L.; Rao, A.; and Agrawala, M. 2023 · 2023
Later among the works it cites.
Fast sampling of diffusion models via operator learning
Zheng, H.; Nie, W.; Vahdat, A.; Azizzadenesheli, K.; and Anandkumar, A. 2023 · 2023
Later among the works it cites.
PixArt- Σ \Sigma : Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation
Chen, J.; Ge, C.; Xie, E.; Wu, Y.; Yao, L.; Ren, X.; Wang, Z.; Luo, P.; Lu, H.; and Li, Z. 2024 · 2024
Closest in time.
Scaling rectified flow transformers for high-resolution image synthesis
Esser, P.; Kulal, S.; Blattmann, A.; Entezari, R.; Müller, J.; Saini, H.; Levi, Y.; Lorenz, D.; Sauer, A.; Boesel, F.; et al. 2024 · 2024
Closest in time.
Plug-and-Play Diffusion Distillation
Hsiao, Y.-T.; Khodadadeh, S.; Duarte, K.; Lin, W.-A.; Qu, H.; Kwon, M.; and Kalarot, R. 2024 · 2024
Closest in time.
Imagine Flash: Accelerating Emu Diffusion Models with Backward Distillation
Kohler, J.; Pumarola, A.; Schönfeld, E.; Sanakoyeu, A.; Sumbaly, R.; Vajda, P.; and Thabet, A. 2024 · 2024
Closest in time.
Snapfusion: Text-to-image diffusion model on mobile devices within two seconds
Li, Y.; Wang, H.; Jin, Q.; Hu, J.; Chemerys, P.; Fu, Y.; Wang, Y.; Tulyakov, S.; and Ren, J. 2024 · 2024
Closest in time.
SDXL-Lightning: Progressive Adversarial Diffusion Distillation
Lin, S.; Wang, A.; and Yang, X. 2024 · 2024
Closest in time.
T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models
Mou, C.; Wang, X.; Xie, L.; Wu, Y.; Zhang, J.; Qi, Z.; and Shan, Y. 2024 · 2024
Closest in time.
Direct preference optimization: Your language model is secretly a reward model
Rafailov, R.; Sharma, A.; Mitchell, E.; Manning, C. D.; Ermon, S.; and Finn, C. 2024 · 2024
Closest in time.
Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis
Ren, Y.; Xia, X.; Lu, Y.; Zhang, J.; Wu, J.; Xie, P.; Wang, X.; and Xiao, X. 2024 · 2024
Closest in time.
Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillation
Sauer, A.; Boesel, F.; Dockhorn, T.; Blattmann, A.; Esser, P.; and Rombach, R. 2024 · 2024
Closest in time.
Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distillation
Wang, Z.; Lu, C.; Wang, Y.; Bao, F.; Li, C.; Su, H.; and Zhu, J. 2024 · 2024
Closest in time.
Improved Distribution Matching Distillation for Fast Image Synthesis
Yin, T.; Gharbi, M.; Park, T.; Zhang, R.; Shechtman, E.; Durand, F.; and Freeman, W. T. 2024 · 2024
Closest in time.
Unipc: A unified predictor-corrector framework for fast sampling of diffusion models
Zhao, W.; Bai, L.; Rao, Y.; Zhou, J.; and Lu, J. 2024 · 2024
Closest in time.