Espresso: Robust Concept Filtering in Text-to-Image Models

Microsoft COCO: Common Objects in Context

Original

Tsung-Yi Lin, Michael Maire, Serge J. Belongie, Lubomir D. Bourdev, Ross B. Girshick, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014 · 2014

Earlier work this paper cites.

Towards Deep Learning Models Resistant to Adversarial Attacks. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings . OpenReview.net

Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. 2018 · 2018

Earlier work this paper cites.

Representation Learning with Contrastive Predictive Coding, In arXiv:1807.03748

Original

Aäron van den Oord, Yazhe Li, and Oriol Vinyals. 2018 · 2018

Earlier work this paper cites.

Captain Marvel vs. captain Marvel: The strange tale of two dueling superheroes

Will Friedwald. 2019 · 2019

Earlier work this paper cites.

Theoretically principled trade-off between robustness and accuracy. In International conference on machine learning . PMLR, PLMR, 7472–7482

Hongyang Zhang, Yaodong Yu, Jiantao Jiao, Eric Xing, Laurent El Ghaoui, and Michael Jordan. 2019 · 2019

Earlier work this paper cites.

CLIPScore: A Reference-free Evaluation Metric for Image Captioning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , Marie-Francine Moens, Xuanjing Huang, Lucia Specia, and Scott Wen-tau Yih (Eds.). Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, 7514–7528

Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, and Yejin Choi. 2021 · 2021

Earlier work this paper cites.

openai/clip-vit-large-patch14 · Hugging Face

HuggingFace. 2021 · 2021

Earlier work this paper cites.

Reading Isn’t Believing: Adversarial Attacks On Multi-Modal Neurons. In arXiv:2103.10480

Original

David A. Noever and Samantha E. Miller Noever. 2021 · 2021

Earlier work this paper cites.

Learning Transferable Visual Models From Natural Language Supervision. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event (Proceedings of Machine Learning Research, Vol. 139) , Marina Meila and Tong Zhang (Eds.). PMLR, 8748–8763

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021 · 2021

Earlier work this paper cites.

DALL·E 2: The Flower That Blooms in Adversity. In OpenAI Blog . OpenAI

Aditya Ramesh, Rishabh Goyal, Alessandro Sordoni, Yaniv Ovadia, and Geoffrey E. Hinton. 2021 · 2021

Earlier work this paper cites.

Poisoning and Backdooring Contrastive Learning. In International Conference on Learning Representations . OpenReview.net

Nicholas Carlini and Andreas Terzis. 2022 · 2022

Earlier work this paper cites.

StyleGAN-NADA: CLIP-guided domain adaptation of image generators

Rinon Gal, Or Patashnik, Haggai Maron, Amit H. Bermano, Gal Chechik, and Daniel Cohen-Or. 2022 · 2022

Earlier work this paper cites.

DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation. In CVPR . 2426–2435

Gwanghyun Kim et al · 2022

Cited alongside, same era.

Sound-Guided Semantic Image Manipulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE Computer Society, 3377–3386

Seung Hyun Lee, Wonseok Roh, Wonmin Byeon, Sang Ho Yoon, Chanyoung Kim, Jinkyu Kim, and Sangpil Kim. 2022 · 2022

Cited alongside, same era.

Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning. In NeurIPS . OpenReview.net

Weixin Liang, Yuhui Zhang, Yongchan Kwon, Serena Yeung, and James Zou. 2022 · 2022

Cited alongside, same era.

Laion-5b: An open large-scale dataset for training next generation image-text models. In Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track . 1–2

Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade W Gordon, Ross Wightman, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, Patrick Schramowski, Srivatsa R Kundurthy, Katherine Crowson, Ludwig Schmidt, Robert Kaczmarczyk, and Jenia Jitsev. 2022 · 2022

Cited alongside, same era.

Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery. In Thirty-seventh Conference on Neural Information Processing Systems . OpenReview.net

Yuxin Wen, Neel Jain, John Kirchenbauer, Micah Goldblum, Jonas Geiping, and Tom Goldstein. 2023 · 2023

Later among the works it cites.

Robust Contrastive Language-Image Pretraining against Data Poisoning and Backdoor Attacks. In Thirty-seventh Conference on Neural Information Processing Systems . OpenReview.net

Wenhan Yang, Jingdong Gao, and Baharan Mirzasoleiman. 2023 · 2023

Later among the works it cites.

Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Models. In ACM SIGSAC Conference on Computer and Communications Security (CCS) . ACM

Qu Yiting, Shen Xinyue, He Xinlei, Backes Michael, Zannettou Savvas, and Zhang Yang. 2023 · 2023

Later among the works it cites.

Unified Concept Editing in Diffusion Models. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) . IEEE Computer Society, 5111–5120

Rohit Gandikota, Hadas Orgad, Yonatan Belinkov, Joanna Materzyńska, and David Bau. 2024 · 2024