Progressive Knowledge Distillation Of Stable Diffusion XL Using Layer Level Loss

Deep residual learning for image recognition, 2015

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2015

Earlier work this paper cites.

Adam: A method for stochastic optimization, 2017

Diederik P. Kingma and Jimmy Ba · 2017

Earlier work this paper cites.

Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter, 2020

Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf · 2020

Earlier work this paper cites.

Zero-shot text-to-image generation, 2021

Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever · 2021

Earlier work this paper cites.

High-resolution image synthesis with latent diffusion models

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022

Cited alongside, same era.

Photorealistic text-to-image diffusion models with deep language understanding, 2022

Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, and Mohammad Norouzi · 2022

Cited alongside, same era.

Bk-sdm: A lightweight, fast, and cheap version of stable diffusion, 2023

Bo-Kyeong Kim, Hyoung-Kyu Song, Thibault Castells, and Shinkook Choi · 2023

Cited alongside, same era.

Snapfusion: Text-to-image diffusion model on mobile devices within two seconds, 2023

Yanyu Li, Huan Wang, Qing Jin, Ju Hu, Pavlo Chemerys, Yun Fu, Yanzhi Wang, Sergey Tulyakov, and Jian Ren · 2023

Cited alongside, same era.

Latent consistency models: Synthesizing high-resolution images with few-step inference, 2023a

Simian Luo, Yiqin Tan, Longbo Huang, Jian Li, and Hang Zhao

Cited in the paper.

Lcm-lora: A universal stable-diffusion acceleration module, 2023b

Simian Luo, Yiqin Tan, Suraj Patil, Daniel Gu, Patrick von Platen, Apolinário Passos, Longbo Huang, Jian Li, and Hang Zhao

Cited in the paper.

Kosmos-2: Grounding multimodal large language models to the world

Original

Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, and Furu Wei · 2023

Later among the works it cites.

Wuerstchen: An efficient architecture for large-scale text-to-image diffusion models, 2023

Pablo Pernias, Dominic Rampas, Mats L. Richter, Christopher J. Pal, and Marc Aubreville · 2023

Later among the works it cites.

Sdxl: Improving latent diffusion models for high-resolution image synthesis, 2023

Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas Müller, Joe Penna, and Robin Rombach · 2023

Later among the works it cites.

If by deepfloyd lab at stabilityai, 2023

Original

Alex Shonenkov, Misha Konstantinov, Daria Bakshandaeva, Christoph Schuhmann, Ksenia Ivanova, and Nadiia Klokova · 2023

Later among the works it cites.