Red-Teaming the Stable Diffusion Safety Filter

Understand

Stable Diffusion is a recent open-source image generation model comparable to proprietary models such as DALLE, Imagen, or Parti.

• Stable Diffusion comes with a safety filter that aims to prevent generating explicit images.
• Unfortunately, the filter is obfuscated and poorly documented.
• This makes it hard for users to prevent misuse in their applications, and to understand the filter's limitations and improve it.