Dark Miner: Defend against undesirable generation for text-to-image diffusion models

T.-Y. Lin et al. , “Microsoft COCO: Common objects in context,” in Proceedings of the European Conference on Computer Vision , 2014, pp. 740–755

2014

Earlier work this paper cites.

O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional networks for biomedical image segmentation,” in Proceedings of the Medical Image Computing and Computer-Assisted Intervention , 2015, pp. 234–241

2015

Earlier work this paper cites.

J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” in Advances in Neural Information Processing Systems , vol. 33, 2020, pp. 6840–6851

2020

Earlier work this paper cites.

F. Croce and M. Hein, “Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks,” in International Conference on Machine Learning , 2020, pp. 2206–2216

2020

Earlier work this paper cites.

J. Howard and S. Gugger, “FastAI: A layered api for deep learning,” Information , vol. 11, p. 108, 2020

2020

Earlier work this paper cites.

A. Radford et al. , “Learning transferable visual models from natural language supervision,” in Proceedings of the International Conference on Machine Learning , 2021, pp. 8748–8763

2021

Earlier work this paper cites.

E. J. Hu et al. , “LoRA: Low-rank adaptation of large language models,” in Proceedings of the International Conference on Learning Representations , 2021

2021

Earlier work this paper cites.

R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-resolution image synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 10 684–10 695

2022

Earlier work this paper cites.

P. Schramowski, C. Tauchmann, and K. Kersting, “Can machines help us answering question 16 in datasheets, and in turn reflecting on inappropriate content?” in Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency , 2022, pp. 1350–1361

2022

Earlier work this paper cites.

C. Schuhmann et al. , “Laion-5b: An open large-scale dataset for training next generation image-text models,” Advances in Neural Information Processing Systems , vol. 35, pp. 25 278–25 294, 2022

2022

Earlier work this paper cites.

V. W. Liang, Y. Zhang, Y. Kwon, S. Yeung, and J. Y. Zou, “Mind the gap: Understanding the modality gap in multi-modal contrastive representation learning,” in Advances in Neural Information Processing Systems , vol. 35, 2022, pp. 17 612–17 625

2022

Earlier work this paper cites.

Y. Qu, X. Shen, X. He, M. Backes, S. Zannettou, and Y. Zhang, “Unsafe diffusion: On the generation of unsafe images and hateful memes from text-to-image models,” in Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security , 2023, pp. 3403–3417

2023

Earlier work this paper cites.

P. Schramowski, M. Brack, B. Deiseroth, and K. Kersting, “Safe Latent Diffusion: Mitigating inappropriate degeneration in diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 22 522–22 531

2023

Earlier work this paper cites.

R. Gandikota, J. Materzynska, J. Fiotto-Kaufman, and D. Bau, “Erasing concepts from diffusion models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 2426–2436

2023

Earlier work this paper cites.

N. Kumari, B. Zhang, S.-Y. Wang, E. Shechtman, R. Zhang, and J.-Y. Zhu, “Ablating concepts in text-to-image diffusion models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 22 691–22 702

2023

Cited alongside, same era.

M. Pham, K. O. Marshall, N. Cohen, G. Mittal, and C. Hegde, “Circumventing concept erasure methods for text-to-image generative models,” in Proceedings of the International Conference on Learning Representations , 2023

2023

Cited alongside, same era.

Y. Lyu, T. Lin, F. Li, D. He, J. Dong, and T. Tan, “Delta-Edit: Exploring text-free training for text-driven image manipulation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 6894–6903

2023

Cited alongside, same era.

Y. Balaji et al. , “eDiff-I: Text-to-image diffusion models with an ensemble of expert denoisers,” arXiv preprint arXiv:2211.01324 , 2023

Original

2023

Cited alongside, same era.

C. Kim, K. Min, and Y. Yang, “RACE: Robust adversarial concept erasure for secure text-to-image diffusion model,” arXiv preprint arXiv:2405.16341 , 2024

Original

2024

Closest in time.

C.-P. Huang, K.-P. Chang, C.-T. Tsai, Y.-H. Lai, and Y.-C. F. Wang, “Receler: Reliable concept erasing of text-to-image diffusion models via lightweight erasers,” in Proceedings of the European Conference on Computer Vision , 2024

2024

Closest in time.

C. Fan, J. Liu, Y. Zhang, D. Wei, E. Wong, and S. Liu, “SalUn: Empowering machine unlearning via gradient-based weight saliency in both image classification and generation,” in Proceedings of the International Conference on Learning Representations , 2024

2024

Closest in time.

R. Liu, A. Khakzar, J. Gu, Q. Chen, P. Torr, and F. Pizzati, “Latent Guard: A safety framework for text-to-image generation,” in Proceedings of the European Conference on Computer Vision , 2024, pp. 93–109

2024

Closest in time.