2023

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models

Gandikota, Rohit, Materzynska, Joanna, Zhou, Tingrui et al.

Understand

We present a method to create interpretable concept sliders that enable precise control over attributes in image generations from diffusion models.

  • Our approach identifies a low-rank parameter direction corresponding to one concept while minimizing interference with other attributes.
  • A slider is created using a small set of prompts or sample images; thus slider directions can be created for either textual or visual concepts.
  • Concept Sliders are plug-and-play: they can be composed efficiently and continuously modulated, enabling precise control over image generation.

Reading the bibliography…