Enhancing Adversarial Robustness of Vision-Language Models through Low-Rank Adaptation

Intriguing properties of neural networks

Original

Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. 2013 · 2013

Earlier work this paper cites.

Artificial general intelligence: concept, state of the art, and future prospects

Ben Goertzel. 2014 · 2014

Earlier work this paper cites.

Explaining and harnessing adversarial examples

Original

Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. 2014 · 2014

Earlier work this paper cites.

Microsoft coco: Common objects in context. In ECCV . 740–755

Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014 · 2014

Earlier work this paper cites.

Flickr30k entities: Collecting region-to-phrase correspondences for richer image-to-sentence models. In ICCV . 2641–2649

Bryan A Plummer, Liwei Wang, Chris M Cervantes, Juan C Caicedo, Julia Hockenmaier, and Svetlana Lazebnik. 2015 · 2015

Earlier work this paper cites.

Adversarial machine learning at scale

Original

Alexey Kurakin, Ian Goodfellow, and Samy Bengio. 2016 · 2016

Earlier work this paper cites.

Accessorize to a crime: Real and stealthy attacks on state-of-the-art face recognition. In Proceedings of the 2016 acm sigsac conference on computer and communications security . 1528–1540

Mahmood Sharif, Sruti Bhagavatula, Lujo Bauer, and Michael K Reiter. 2016 · 2016

Earlier work this paper cites.

Msr-vtt: A large video description dataset for bridging video and language. In CVPR . 5288–5296

Jun Xu, Tao Mei, Ting Yao, and Yong Rui. 2016 · 2016

Earlier work this paper cites.

Localizing moments in video with natural language. In ICCV . 5803–5812

Lisa Anne Hendricks, Oliver Wang, Eli Shechtman, Josef Sivic, Trevor Darrell, and Bryan Russell. 2017 · 2017

Earlier work this paper cites.

Zoo: Zeroth order optimization based black-box attacks to deep neural networks without training substitute models. In Proceedings of the 10th ACM workshop on artificial intelligence and security . 15–26

Pin-Yu Chen, Huan Zhang, Yash Sharma, Jinfeng Yi, and Cho-Jui Hsieh. 2017 · 2017

Earlier work this paper cites.

Towards deep learning models resistant to adversarial attacks

Original

Aleksander Madry. 2017 · 2017

Earlier work this paper cites.

On detecting adversarial perturbations

Original

Jan Hendrik Metzen, Tim Genewein, Volker Fischer, and Bastian Bischoff. 2017 · 2017

Earlier work this paper cites.

Growing a brain: Fine-tuning by increasing model capacity. In CVPR . 2471–2480

Yu-Xiong Wang, Deva Ramanan, and Martial Hebert. 2017 · 2017

Earlier work this paper cites.

Adversarial detection with model interpretation. In KDD . 1803–1811

Ninghao Liu, Hongxia Yang, and Xia Hu. 2018 · 2018

Earlier work this paper cites.

Generalizing to unseen domains via adversarial data augmentation

Riccardo Volpi, Hongseok Namkoong, Ozan Sener, John C Duchi, Vittorio Murino, and Silvio Savarese. 2018 · 2018

Earlier work this paper cites.

Adversarial attacks on medical machine learning

Samuel G Finlayson, John D Bowers, Joichi Ito, Jonathan L Zittrain, Andrew L Beam, and Isaac S Kohane. 2019 · 2019

Earlier work this paper cites.

Towards artificial general intelligence with hybrid Tianjic chip architecture

Jing Pei, Lei Deng, Sen Song, Mingguo Zhao, Youhui Zhang, Shuang Wu, Guanrui Wang, Zhe Zou, Zhenzhi Wu, Wei He, et al · 2019

Earlier work this paper cites.

Sparse adversarial perturbations for videos. In AAAI . 8973–8980

Xingxing Wei, Jun Zhu, Sha Yuan, and Hang Su. 2019 · 2019

Earlier work this paper cites.

Square attack: a query-efficient black-box adversarial attack via random search. In ECCV . Springer, 484–501

Maksym Andriushchenko, Francesco Croce, Nicolas Flammarion, and Matthias Hein. 2020 · 2020

Earlier work this paper cites.

Large-scale adversarial training for vision-and-language representation learning

Zhe Gan, Yen-Chun Chen, Linjie Li, Chen Zhu, Yu Cheng, and Jingjing Liu. 2020 · 2020

Earlier work this paper cites.

Adversarial training for large neural language models

Original

Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, and Jianfeng Gao. 2020 · 2020

Earlier work this paper cites.

TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP. In EMNLP . 119–126

John Morris, Eli Lifland, Jin Yong Yoo, Jake Grigsby, Di Jin, and Yanjun Qi. 2020 · 2020

Earlier work this paper cites.

Bag of tricks for adversarial training

Original

Tianyu Pang, Xiao Yang, Yinpeng Dong, Hang Su, and Jun Zhu. 2020 · 2020

Cited alongside, same era.

Frozen in time: A joint video and image encoder for end-to-end retrieval. In ICCV . 1728–1738

Max Bain, Arsha Nagrani, Gül Varol, and Andrew Zisserman. 2021 · 2021

Cited alongside, same era.

Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment

Shuo Feng, Xintao Yan, Haowei Sun, Yiheng Feng, and Henry X Liu. 2021 · 2021

Cited alongside, same era.

Lora: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Cited alongside, same era.

Understanding adversarial attacks on deep learning based medical image analysis systems

Xingjun Ma, Yuhao Niu, Lin Gu, Yisen Wang, Yitian Zhao, James Bailey, and Feng Lu. 2021 · 2021

One transformer fits all distributions in multi-modal diffusion at scale

Original

Fan Bao, Shen Nie, Kaiwen Xue, Chongxuan Li, Shi Pu, Yaole Wang, Gang Yue, Yue Cao, Hang Su, and Jun Zhu. 2023 · 2023

Later among the works it cites.

CLAP: Contrastive Learning with Augmented Prompts for Robustness on Pretrained Vision-Language Models

Original

Yichao Cai, Yuhang Liu, Zhen Zhang, and Javen Qinfeng Shi. 2023 · 2023

Later among the works it cites.

Qlora: Efficient finetuning of quantized llms

Original

Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023 · 2023

Later among the works it cites.

Clip-adapter: Better vision-language models with feature adapters

Peng Gao, Shijie Geng, Renrui Zhang, Teli Ma, Rongyao Fang, Yongfeng Zhang, Hongsheng Li, and Yu Qiao. 2023 · 2023

Later among the works it cites.

GPT understands, too

Xiao Liu, Yanan Zheng, Zhengxiao Du, Ming Ding, Yujie Qian, Zhilin Yang, and Jie Tang. 2023 · 2023