2024

aMUSEd: An Open MUSE Reproduction

Patil, Suraj, Berman, William, Rombach, Robin et al.

Understand

We present aMUSEd, an open-source, lightweight masked image model (MIM) for text-to-image generation based on MUSE.

  • With 10 percent of MUSE's parameters, aMUSEd is focused on fast image generation.
  • We believe MIM is under-explored compared to latent diffusion, the prevailing approach for text-to-image generation.
  • Compared to latent diffusion, MIM requires fewer inference steps and is more interpretable.

Reading the bibliography…