Replace-then-Perturb: Targeted Adversarial Attacks With Visual Reasoning for Vision-Language Models

N. Reimers and I. Gurevych, “Sentence-BERT: Sentence embeddings using siamese BERT-networks,” in Proc. Conf. Empir. Methods Nat. Lang. Process. (EMNLP) , 11 2019. [Online]. Available: https://arxiv.org/abs/1908.10084

Original

1908

Earlier work this paper cites.

X. Wang and K. He, “Enhancing the transferability of adversarial attacks through variance tuning,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , 2021, pp. 1924–1933

1933

Earlier work this paper cites.

K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, “Bleu: a method for automatic evaluation of machine translation,” in Annu. Meet. Assoc. Comput. Linguist. , 2002, pp. 311–318

2002

Earlier work this paper cites.

I. J. Goodfellow, “Explaining and harnessing adversarial examples,” arXiv preprint arXiv:1412.6572 , 2014

Original

2014

Earlier work this paper cites.

C. Napoles, K. Sakaguchi, M. Post, and J. Tetreault, “Ground truth for grammatical error correction metrics,” in Annu. Meet. Assoc. Comput. Linguist. , 2015, pp. 588–593

2015

Earlier work this paper cites.

S. Baluja, “Hiding images in plain sight: Deep steganography,” Proc. Adv. Neural Inform. Process. Syst. (NeurIPS) , vol. 30, 2017

2017

Earlier work this paper cites.

J. Lu, T. Issaranon, and D. Forsyth, “Safetynet: Detecting and rejecting adversarial examples robustly,” in Proc. Int. Conf. Comput. Vis. (ICCV) , 2017, pp. 446–454

2017

Earlier work this paper cites.

X. Xu, X. Chen, C. Liu, A. Rohrbach, T. Darrell, and D. Song, “Fooling vision and language models despite localization and attention mechanism,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , 2018, pp. 4951–4961

2018

Earlier work this paper cites.

Y. Dong, F. Liao, T. Pang, H. Su, J. Zhu, X. Hu, and J. Li, “Boosting adversarial attacks with momentum,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , 2018, pp. 9185–9193

2018

Earlier work this paper cites.

J. Cohen, E. Rosenfeld, and Z. Kolter, “Certified adversarial robustness via randomized smoothing,” in Proc. Int. Conf. on Mach. Learn. (ICML) . PMLR, 2019, pp. 1310–1320

2019

Earlier work this paper cites.

J. Lin, C. Song, K. He, L. Wang, and J. E. Hopcroft, “Nesterov accelerated gradient and scale invariance for adversarial attacks,” arXiv preprint arXiv:1908.06281 , 2019

Original

2019

Earlier work this paper cites.

C. Xie, Z. Zhang, Y. Zhou, S. Bai, J. Wang, Z. Ren, and A. L. Yuille, “Improving transferability of adversarial examples with input diversity,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , 2019, pp. 2730–2739

2019

Earlier work this paper cites.

M. Shah, X. Chen, M. Rohrbach, and D. Parikh, “Cycle-consistency for robust visual question answering,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , 2019, pp. 6649–6658

2019

Earlier work this paper cites.

J. Hessel, A. Holtzman, M. Forbes, R. L. Bras, and Y. Choi, “Clipscore: A reference-free evaluation metric for image captioning,” arXiv preprint arXiv:2104.08718 , 2021

Original

2021

Earlier work this paper cites.

K. Yang, W.-Y. Lin, M. Barman, F. Condessa, and Z. Kolter, “Defending multimodal fusion models against single-source adversaries,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , 2021, pp. 3340–3349

Original

2021

Earlier work this paper cites.

J. Zhang, Q. Yi, and J. Sang, “Towards adversarial attack on vision-language pre-training models,” in Proc. ACM Int. Conf. Multimedia (ACM MM) , 2022, pp. 5005–5013

2022

Cited alongside, same era.

N. Carlini, F. Tramer, K. D. Dvijotham, L. Rice, M. Sun, and J. Z. Kolter, “(certified!!) adversarial robustness for free!” arXiv preprint arXiv:2206.10550 , 2022

Original

2022

Cited alongside, same era.

C. Mao, S. Geng, J. Yang, X. Wang, and C. Vondrick, “Understanding zero-shot adversarial robustness for large-scale models,” arXiv preprint arXiv:2212.07016 , 2022

Original

2022

Cited alongside, same era.

T. Lüddecke and A. Ecker, “Image segmentation using text and image prompts,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , 2022, pp. 7086–7096

2022

Cited alongside, same era.

H. Liu, C. Li, Y. Li, and Y. J. Lee, “Improved baselines with visual instruction tuning,” arXiv preprint arXiv:2310.03744 , 2023

Original

2023

Later among the works it cites.

S. Ge, C. Zhou, R. Hou, M. Khabsa, Y.-C. Wang, Q. Wang, J. Han, and Y. Mao, “Mart: Improving llm safety with multi-round automatic red-teaming,” arXiv preprint arXiv:2311.07689 , 2023

Original

2023

Later among the works it cites.

A. Shakhmatov et al. , “kandinsky 2.2,” 2023

2023

Later among the works it cites.

D. L. at StabilityAI, “DeepFloyd IF: a novel state-of-the-art open-source text-to-image model with a high degree of photorealism and language understanding,” https://www.deepfloyd.ai/deepfloyd-if, 2023, retrieved on 2023-11-08

2023

Later among the works it cites.

Anthropic, “The claude 3 model family: Opus, Sonnet, Haiku,” Preprint , 2024

2024