SwiftDiffusion: Efficient Diffusion Model Serving with Add-on Modules

Reevaluating amdahl’s law

John L. Gustafson · 1988

Earlier work this paper cites.

Image quality assessment: From error visibility to structural similarity

Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli · 2004

Earlier work this paper cites.

U-Net: Convolutional networks for biomedical image segmentation

Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015

Earlier work this paper cites.

Clipper: A low-latency online prediction serving system

Daniel Crankshaw, Xin Wang, Guilio Zhou, Michael J. Franklin, Joseph E. Gonzalez, and Ion Stoica · 2017

Earlier work this paper cites.

Gans trained by a two time-scale update rule converge to a local nash equilibrium

Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter · 2017

Earlier work this paper cites.

The unreasonable effectiveness of deep features as a perceptual metric

Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang · 2018

Earlier work this paper cites.

MArk: Exploiting cloud services for cost-effective, SLO-aware machine learning inference serving

Chengliang Zhang, Minchen Yu, Wei Wang, and Feng Yan · 2019

Earlier work this paper cites.

Serving DNNs like Clockwork: Performance predictability from the bottom up

Arpan Gujarati, Reza Karimi, Safya Alzayat, Wei Hao, Antoine Kaufmann, Ymir Vigfusson, and Jonathan Mace · 2020

Earlier work this paper cites.

CLIPScore: A reference-free evaluation metric for image captioning

Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, and Yejin Choi · 2021

Earlier work this paper cites.

Classifier-free diffusion guidance

Jonathan Ho and Tim Salimans · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021

Earlier work this paper cites.

Morphling: Fast, near-optimal auto-configuration for cloud-native model serving

Luping Wang, Lingyun Yang, Yinghao Yu, Wei Wang, Bo Li, Xianchao Sun, Jian He, and Liping Zhang · 2021

Earlier work this paper cites.

Cocktail: A multidimensional optimization for model serving in cloud

Jashwant Raj Gunasekaran, Cyan Subhra Mishra, Prashanth Thinakaran, Bikash Sharma, Mahmut Taylan Kandemir, and Chita R. Das · 2022

Earlier work this paper cites.

LoRA: Low-rank adaptation of large language models

Edward J Hu, yelong shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen · 2022

Earlier work this paper cites.

PEFT: State-of-the-art parameter-efficient fine-tuning methods

Sourab Mangrulkar, Sylvain Gugger, Lysandre Debut, Younes Belkada, Sayak Paul, and Benjamin Bossan · 2022

Earlier work this paper cites.

High-resolution image synthesis with latent diffusion models

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022

Earlier work this paper cites.

Diffusers: State-of-the-art diffusion models

Patrick von Platen, Suraj Patil, Anton Lozhkov, Pedro Cuenca, Nathan Lambert, Kashif Rasul, Mishig Davaadorj, Dhruv Nair, Sayak Paul, William Berman, Yiyi Xu, Steven Liu, and Thomas Wolf · 2022

Earlier work this paper cites.

INFless: A native serverless system for low-latency, high-throughput inference

Yanan Yang, Laiping Zhao, Yiming Li, Huanyu Zhang, Jie Li, Mingyang Zhao, Xingzhen Chen, and Keqiu Li · 2022

Earlier work this paper cites.

Orca: A distributed serving system for transformer-based generative models

Gyeong-In Yu, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, and Byung-Gon Chun · 2022

Earlier work this paper cites.

Scaling autoregressive models for content-rich text-to-image generation

Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, and Yonghui Wu · 2022

Earlier work this paper cites.

Adobe unleashes new era of creativity for all with the commercial release of generative AI

Adobe · 2023

Cited alongside, same era.

Scalable diffusion models with transformers

William Peebles and Saining Xie · 2023

Cited alongside, same era.

S-LoRA: Serving thousands of concurrent LoRA adapters

Ying Sheng, Shiyi Cao, Dacheng Li, Coleman Hooper, Nicholas Lee, Shuo Yang, Christopher Chou, Banghua Zhu, Lianmin Zheng, Kurt Keutzer, Joseph E. Gonzalez, and Ion Stoica · 2023

Cited alongside, same era.

Tabi: An efficient multi-level inference system for large language models

Yiding Wang, Kai Chen, Haisheng Tan, and Kun Guo · 2023

Cited alongside, same era.

MGG: Accelerating graph neural networks with fine-grained intra-kernel communication-computation pipelining on multi-GPU platforms

Yuke Wang, Boyuan Feng, Zheng Wang, Tong Geng, Kevin Barker, Ang Li, and Yufei Ding · 2023

Cited alongside, same era.

Punica: Multi-tenant LoRA serving

Lequn Chen, Zihao Ye, Yongji Wu, Danyang Zhuo, Luis Ceze, and Arvind Krishnamurthy · 2024

Closest in time.

Scaling rectified flow transformers for high-resolution image synthesis

Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, Dustin Podell, Tim Dockhorn, Zion English, and Robin Rombach · 2024

Closest in time.

Huggingface diffusers sdxl controlnets

HuggingFace · 2024

Closest in time.

BrushNet: a plug-and-play image inpainting model with decomposed dual-branch diffusion

Xuan Ju, Xian Liu, Xintao Wang, Yuxuan Bian, Ying Shan, and Qiang Xu · 2024

Closest in time.

DistriFusion: Distributed parallel inference for high-resolution diffusion models

Muyang Li, Tianle Cai, Jiaxin Cao, Qinsheng Zhang, Han Cai, Junjie Bai, Yangqing Jia, Ming-Yu Liu, Kai Li, and Song Han · 2024

Closest in time.

CaraServe: CPU-assisted and rank-aware LoRA serving for generative LLM inference