The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies

Mitigating Poisoning Attacks on Machine Learning Models: A Data Provenance Based Approach. In Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security (AISec ’17) . Association for Computing Machinery, New York, NY, USA, 103–110

Nathalie Baracaldo, Bryant Chen, Heiko Ludwig, and Jaehoon Amir Safavi. 2017 · 2017

Earlier work this paper cites.

Ethical Challenges in Data-Driven Dialogue Systems

Original

Peter Henderson, Koustuv Sinha, Nicolas Angelard-Gontier, Nan Rosemary Ke, Genevieve Fried, Ryan Lowe, and Joelle Pineau. 2017 · 2017

Earlier work this paper cites.

Universal Language Model Fine-tuning for Text Classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (Melbourne, Australia), Iryna Gurevych and Yusuke Miyao (Eds.). Association for Computational Linguistics, 328–339

Jeremy Howard and Sebastian Ruder. 2018 · 2018

Earlier work this paper cites.

Privacy and Security of Big Data in AI Systems: A Research and Standards Perspective. In 2019 IEEE International Conference on Big Data (Big Data) . 5737–5743

Saharnaz Dilmaghani, Matthias R. Brust, Grégoire Danoy, Natalia Cassagnes, Johnatan Pecero, and Pascal Bouvry. 2019 · 2019

Earlier work this paper cites.

Machine Learning Security: Threats, Countermeasures, and Evaluations

Mingfu Xue, Chengxiang Yuan, Heyi Wu, Yushu Zhang, and Weiqiang Liu. 2020 · 2020

Earlier work this paper cites.

Extracting Training Data from Large Language Models. In 30th USENIX Security Symposium (USENIX Security 21) . 2633–2650

Nicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, Alina Oprea, and Colin Raffel. 2021 · 2021

Earlier work this paper cites.

BERTective: Language Models and Contextual Information for Deception Detection. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (Online). Association for Computational Linguistics, 2699–2708

Tommaso Fornaciari, Federico Bianchi, Massimo Poesio, and Dirk Hovy. 2021 · 2021

Earlier work this paper cites.

Membership Privacy for Machine Learning Models Through Knowledge Transfer

Virat Shejwalkar and Amir Houmansadr. 2021 · 2021

Earlier work this paper cites.

Data-Free Model Extraction. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 4769–4778

Jean-Baptiste Truong, Pratyush Maini, Robert J. Walls, and Nicolas Papernot. 2021 · 2021

Earlier work this paper cites.

Differentially Private Fine-tuning of Language Models. In International Conference on Learning Representations

Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin A. Inan, Gautam Kamath, Janardhan Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, and Huishuai Zhang. 2021 · 2021

Earlier work this paper cites.

ChatGPT

2022 · 2022

Earlier work this paper cites.

LangChain

Harrison Chase. 2022 · 2022

Earlier work this paper cites.

Deduplicating Training Data Makes Language Models Better. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (Dublin, Ireland), Smaranda Muresan, Preslav Nakov, and Aline Villavicencio (Eds.). Association for Computational Linguistics, 8424–8445

Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, and Nicholas Carlini. 2022 · 2022

Earlier work this paper cites.

Multi-Objective Learning to Overcome Catastrophic Forgetting in Time-series Applications

Reem A. Mahmoud and Hazem Hajj. 2022 · 2022

Earlier work this paper cites.

Downstream Task Performance of BERT Models Pre-Trained Using Automatically De-Identified Clinical Data. In Proceedings of the Thirteenth Language Resources and Evaluation Conference (Marseille, France), Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, and Stelios Piperidis (Eds.). European Language Resources Association, 4245–4252

Thomas Vakili, Anastasios Lamproudis, Aron Henriksson, and Hercules Dalianis. 2022 · 2022

Earlier work this paper cites.

Gemini - Chat to Supercharge Your Ideas

2023 · 2023

Earlier work this paper cites.

Malicious ChatGPT Agents: How GPTs Can Quietly Grab Your Data (Demo) · Embrace The Red

Embrace The Red 2023 · 2023

Earlier work this paper cites.

What Are Large Language Model (LLM) Agents and Autonomous Agents

Prompt Engineering 2023 · 2023

Earlier work this paper cites.

Characterizing Attribution and Fluency Tradeoffs for Retrieval-Augmented Large Language Models

Original

Renat Aksitov, Chung-Ching Chang, David Reitter, Siamak Shakeri, and Yunhsuan Sung. 2023 · 2023

Earlier work this paper cites.

Frontier AI Regulation: Managing Emerging Risks to Public Safety

Original

Markus Anderljung, Joslyn Barnhart, Anton Korinek, Jade Leung, Cullen O’Keefe, Jess Whittlestone, Shahar Avin, Miles Brundage, Justin Bullock, Duncan Cass-Beggs, Ben Chang, Tantum Collins, Tim Fist, Gillian Hadfield, Alan Hayes, Lewis Ho, Sara Hooker, Eric Horvitz, Noam Kolt, Jonas Schuett, Yonadav Shavit, Divya Siddarth, Robert Trager, and Kevin Wolf. 2023 · 2023

Earlier work this paper cites.

ChemCrow: Augmenting Large-Language Models with Chemistry Tools

Original

Andres M. Bran, Sam Cox, Oliver Schilter, Carlo Baldassari, Andrew D. White, and Philippe Schwaller. 2023 · 2023

Earlier work this paper cites.

From Text to MITRE Techniques: Exploring the Malicious Use of Large Language Models for Generating Cyber Attack Payloads

Original

P. V. Sai Charan, Hrushikesh Chunduri, P. Mohan Anand, and Sandeep K. Shukla. 2023 · 2023

Earlier work this paper cites.

MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots

Original

Gelei Deng, Yi Liu, Yuekang Li, Kailong Wang, Ying Zhang, Zefeng Li, Haoyu Wang, Tianwei Zhang, and Yang Liu. 2023 · 2023

Earlier work this paper cites.

Toxicity in ChatGPT: Analyzing Persona-assigned Language Models

Original

Ameet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, and Karthik Narasimhan. 2023 · 2023

Earlier work this paper cites.

Chain-of-Verification Reduces Hallucination in Large Language Models

Original

Shehzaad Dhuliawala, Mojtaba Komeili, Jing Xu, Roberta Raileanu, Xian Li, Asli Celikyilmaz, and Jason Weston. 2023 · 2023

Earlier work this paper cites.

Decoding the Threat Landscape : ChatGPT, FraudGPT, and WormGPT in Social Engineering Attacks

Polra Victor Falade. 2023 · 2023

Earlier work this paper cites.

Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration

Original

Wenjie Fu, Huandong Wang, Chen Gao, Guanghua Liu, Yong Li, and Tao Jiang. 2023 · 2023

Earlier work this paper cites.

Not What You’ve Signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection

Original

Kai Greshake, Sahar Abdelnabi, Shailesh Mishra, Christoph Endres, Thorsten Holz, and Mario Fritz. 2023 · 2023

Earlier work this paper cites.

MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework

Original

Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jürgen Schmidhuber. 2023 · 2023

Earlier work this paper cites.

A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions

Original

Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, and Ting Liu. 2023 · 2023

Earlier work this paper cites.

Training Data Extraction From Pre-trained Language Models: A Survey. In Proceedings of the 3rd Workshop on Trustworthy Natural Language Processing (TrustNLP 2023) (Toronto, Canada), Anaelia Ovalle, Kai-Wei Chang, Ninareh Mehrabi, Yada Pruksachatkun, Aram Galystan, Jwala Dhamala, Apurv Verma, Trista Cao, Anoop Kumar, and Rahul Gupta (Eds.). Association for Computational Linguistics, 260–275

Shotaro Ishihara. 2023 · 2023

Earlier work this paper cites.

Combing for Credentials: Active Pattern Extraction from Smart Reply

Original

Bargav Jayaraman, Esha Ghosh, Melissa Chase, Sambuddha Roy, Wei Dai, and David Evans. 2023 · 2023

Cited alongside, same era.

Towards Mitigating Hallucination in Large Language Models via Self-Reflection

Original

Ziwei Ji, Tiezheng Yu, Yan Xu, Nayeon Lee, Etsuko Ishii, and Pascale Fung. 2023 · 2023

Cited alongside, same era.

ProPILE: Probing Privacy Leakage in Large Language Models

Original

Siwon Kim, Sangdoo Yun, Hwaran Lee, Martin Gubri, Sungroh Yoon, and Seong Joon Oh. 2023 · 2023

Cited alongside, same era.

Multi-Step Jailbreaking Privacy Attacks on ChatGPT

Original

Haoran Li, Dadi Guo, Wei Fan, Mingshi Xu, Jie Huang, Fanpu Meng, and Yangqiu Song. 2023 · 2023

Cited alongside, same era.

Noise Imitation Based Adversarial Training for Robust Multimodal Sentiment Analysis

Ziqi Yuan, Yihe Liu, Hua Xu, and Kai Gao. 2024 · 2023

Later among the works it cites.

Investigating the Catastrophic Forgetting in Multimodal Large Language Models

Original

Yuexiang Zhai, Shengbang Tong, Xiao Li, Mu Cai, Qing Qu, Yong Jae Lee, and Yi Ma. 2023 · 2023

Later among the works it cites.

Synergizing Human-AI Agency: A Guide of 23 Heuristics for Service Co-Creation with LLM-Based Agents

Original

Qingxiao Zheng, Zhongwei Xu, Abhinav Choudhary, Yuting Chen, Yongming Li, and Yun Huang. 2023 · 2023

Later among the works it cites.

AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models

Original

Wanjun Zhong, Ruixiang Cui, Yiduo Guo, Yaobo Liang, Shuai Lu, Yanlin Wang, Amin Saied, Weizhu Chen, and Nan Duan. 2023 · 2023

Later among the works it cites.