IP Leakage Attacks Targeting LLM-Based Multi-Agent Systems

N. Carlini, S. Chien, M. Nasr, S. Song, A. Terzis, and F. Tramer, “Membership inference attacks from first principles,” in 2022 IEEE symposium on security and privacy (SP) . IEEE, 2022, pp. 1897–1914

1914

Earlier work this paper cites.

C. Wang, Z. Li, Y. Pena, S. Gao, S. Chen, S. Wang, C. Gao, and M. R. Lyu, “Reef: A framework for collecting real-world vulnerabilities and fixes,” in 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 2023, pp. 1952–1962

1962

Earlier work this paper cites.

Farber, “Topological complexity of motion planning,” Discrete & Computational Geometry , vol. 29, pp. 211–221, 2003

2003

Earlier work this paper cites.

K. Petersen, C. Wohlin, and D. Baca, “The waterfall model in large-scale development,” in Product-Focused Software Process Improvement: 10th International Conference, PROFES 2009, Oulu, Finland, June 15-17, 2009. Proceedings 10 . Springer, 2009, pp. 386–400

2009

Earlier work this paper cites.

X. Gao, B. Xiao, D. Tao, and X. Li, “A survey of graph edit distance,” Pattern Analysis and applications , vol. 13, pp. 113–129, 2010

2010

Earlier work this paper cites.

P. Hoffman, M. A. Lambon Ralph, and T. T. Rogers, “Semantic diversity: A measure of semantic ambiguity based on variability in the contextual usage of words,” Behavior research methods , vol. 45, pp. 718–730, 2013

2013

Earlier work this paper cites.

F. Tramèr, F. Zhang, A. Juels, M. K. Reiter, and T. Ristenpart, “Stealing machine learning models via prediction { \{ APIs } \} ,” in 25th USENIX security symposium (USENIX Security 16) , 2016, pp. 601–618

2016

Earlier work this paper cites.

N. Papernot, P. McDaniel, I. Goodfellow, S. Jha, Z. B. Celik, and A. Swami, “Practical black-box attacks against machine learning,” in Proceedings of the 2017 ACM on Asia Conference on Computer and Communications Security , ser. ASIA CCS ’17. New York, NY, USA: Association for Computing Machinery, 2017, p. 506–519. [Online]. Available: https://doi.org/10.1145/3052973.3053009

2017

Earlier work this paper cites.

R. Shokri, M. Stronati, C. Song, and V. Shmatikov, “Membership inference attacks against machine learning models,” in 2017 IEEE symposium on security and privacy (SP) . IEEE, 2017, pp. 3–18

2017

Earlier work this paper cites.

T. Orekondy, B. Schiele, and M. Fritz, “Knockoff nets: Stealing functionality of black-box models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2019, pp. 4954–4963

2019

Earlier work this paper cites.

M. Nasr, R. Shokri, and A. Houmansadr, “Comprehensive privacy analysis of deep learning: Passive and active white-box inference attacks against centralized and federated learning,” in 2019 IEEE symposium on security and privacy (SP) . IEEE, 2019, pp. 739–753

2019

Earlier work this paper cites.

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. teusz Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, “Language models are few-shot learners,” ArXiv , vol. abs/2005.14165, 2020. [Online]. Available: https://api.semanticscholar.org/CorpusID:218971783

Original

2020

Earlier work this paper cites.

D. Jin, E. Pan, N. Oufattole, W.-H. Weng, H. Fang, and P. Szolovits, “What disease does this patient have? a large-scale open domain question answering dataset from medical exams,” arXiv preprint arXiv:2009.13081 , 2020

Original

2020

Earlier work this paper cites.

M. Jagielski, N. Carlini, D. Berthelot, A. Kurakin, and N. Papernot, “High accuracy and high fidelity extraction of neural networks,” in 29th USENIX security symposium (USENIX Security 20) , 2020, pp. 1345–1362

2020

Earlier work this paper cites.

Z. Chen, W. Chen, C. Smiley, S. Shah, I. Borova, D. Langdon, R. Moussa, M. Beane, T.-H. Huang, B. Routledge, and W. Y. Wang, “Finqa: A dataset of numerical reasoning over financial data,” Proceedings of EMNLP 2021 , 2021

2021

Earlier work this paper cites.

F. Perez and I. Ribeiro, “Ignore previous prompt: Attack techniques for language models,” in NeurIPS ML Safety Workshop , 2022. [Online]. Available: https://openreview.net/forum?id=qiaRo_7Zmug

2022

Earlier work this paper cites.

J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou et al. , “Chain-of-thought prompting elicits reasoning in large language models,” Advances in neural information processing systems , vol. 35, pp. 24 824–24 837, 2022

2022

Earlier work this paper cites.

Z. Li, P. Ma, H. Wang, S. Wang, Q. Tang, S. Nie, and S. Wu, “Unleashing the power of compiler intermediate representation to enhance neural program embeddings,” in 44th IEEE/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022 . ACM, 2022

2022

Earlier work this paper cites.

J. Ye, A. Maddi, S. K. Murakonda, V. Bindschaedler, and R. Shokri, “Enhanced membership inference attacks against machine learning models,” in Proceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security , 2022, pp. 3093–3106

2022

Earlier work this paper cites.

W. K. Wong, H. Wang, Z. Li, Z. Liu, S. Wang, Q. Tang, S. Nie, and S. Wu, “Refining decompiled c code with large language models,” arXiv preprint arXiv:2310.06530 , 2023

Original

2023

Earlier work this paper cites.

Y. Zhang, N. Carlini, and D. Ippolito, “Effective prompt extraction from language models,” arXiv preprint arXiv:2307.06865 , 2023

Original

2023

Earlier work this paper cites.

L. Wang, C. Ma, X. Feng, Z. Zhang, H. ran Yang, J. Zhang, Z.-Y. Chen, J. Tang, X. Chen, Y. Lin, W. X. Zhao, Z. Wei, and J. rong Wen, “A survey on large language model based autonomous agents,” Frontiers Comput. Sci. , vol. 18, p. 186345, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:261064713

2023

Earlier work this paper cites.

C. Qian, W. Liu, H. Liu, N. Chen, Y. Dang, J. Li, C. Yang, W. Chen, Y. Su, X. Cong, J. Xu, D. Li, Z. Liu, and M. Sun, “Chatdev: Communicative agents for software development,” in Annual Meeting of the Association for Computational Linguistics , 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:270257715

2023

Earlier work this paper cites.

S. Hong, X. Zheng, J. P. Chen, Y. Cheng, C. Zhang, Z. Wang, S. K. S. Yau, Z. H. Lin, L. Zhou, C. Ran, L. Xiao, and C. Wu, “Metagpt: Meta programming for multi-agent collaborative framework,” International Conference on Learning Representations , 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:260351380

2023

Earlier work this paper cites.

Z. Li, C. Wang, Z. Liu, H. Wang, D. Chen, S. Wang, and C. Gao, “CCTEST: testing and repairing code completion systems,” in 45th IEEE/ACM International Conference on Software Engineering, ICSE 2023, Melbourne, Australia, May 14-20, 2023 . IEEE, 2023, pp. 1238–1250

2023

Earlier work this paper cites.

A. Zou, Z. Wang, J. Z. Kolter, and M. Fredrikson, “Universal and transferable adversarial attacks on aligned language models,” 2023

2023

Earlier work this paper cites.

S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao, “React: Synergizing reasoning and acting in language models,” in International Conference on Learning Representations (ICLR) , 2023

2023

Cited alongside, same era.

M. Nasr, N. Carlini, J. Hayase, M. Jagielski, A. F. Cooper, D. Ippolito, C. A. Choquette-Choo, E. Wallace, F. Tramèr, and K. Lee, “Scalable extraction of training data from (production) language models,” arXiv preprint arXiv:2311.17035 , 2023

Original

2023

Cited alongside, same era.

Z. Li, C. Wang, P. Ma, C. Liu, S. Wang, D. Wu, and C. Gao, “On the feasibility of specialized ability stealing for large language code models,” 2023

2023

Cited alongside, same era.

Z. Li, C. Wang, S. Wang, and G. Cuiyun, “Protecting intellectual property of large language model-based code generation apis via watermarks,” in Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, CCS 2023, Copenhagen, Denmark, November 26-30, 2023 , 2023

2023

Cited alongside, same era.

R. Wen, Z. Li, M. Backes, and Y. Zhang, “Membership inference attacks against in-context learning,” in Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security , ser. CCS ’24. New York, NY, USA: Association for Computing Machinery, 2024, p. 3481–3495. [Online]. Available: https://doi.org/10.1145/3658644.3690306

2024

Later among the works it cites.

J. Shi, Z. Yuan, Y. Liu, Y. Huang, P. Zhou, L. Sun, and N. Z. Gong, “Optimization-based prompt injection attack to llm-as-a-judge,” in Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security , ser. CCS ’24. New York, NY, USA: Association for Computing Machinery, 2024, p. 660–674. [Online]. Available: https://doi.org/10.1145/3658644.3690291

2024

Later among the works it cites.

Z. Sha and Y. Zhang, “Prompt stealing attacks against large language models,” arXiv preprint arXiv:2402.12959 , 2024

Original

2024

Later among the works it cites.