Fetching the paper…
Reading the bibliography…
We present the first in depth study on the robustness of existing watermarking techniques applied to code generated by large language models (LLMs).
WordNet: A lexical database for English
George A. Miller · 1994
Earlier work this paper cites.
Evaluating large language models trained on code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba · 2021
Earlier work this paper cites.
A general construction for abstract interpretation of higher-order automatic differentiation
Jacob Laurel, Rem Yang, Shubham Ugare, Robert Nagel, Gagandeep Singh, and Sasa Misailovic · 2022
Earlier work this paper cites.
Undetectable watermarks for language models, 2023
Miranda Christ, Sam Gunn, and Or Zamir · 2023
Earlier work this paper cites.
Publicly detectable watermarking for language models
Jaiden Fairoze, Sanjam Garg, Somesh Jha, Saeed Mahloujifar, Mohammad Mahmoody, and Mingyuan Wang · 2023
Earlier work this paper cites.
Robust distortion-free watermarks for language models, 2023
Rohith Kuditipudi, John Thickstun, Tatsunori Hashimoto, and Percy Liang · 2023
Earlier work this paper cites.
Who wrote this code? watermarking for code generation, 2023
Taehyun Lee, Seokhee Hong, Jaewoo Ahn, Ilgee Hong, Hwaran Lee, Sangdoo Yun, Jamin Shin, and Gunhee Kim · 2023
Earlier work this paper cites.
Origin tracing and detecting of llms, 2023
Linyang Li, Pengyu Wang, Ke Ren, Tianxiang Sun, and Xipeng Qiu · 2023
Earlier work this paper cites.
Detectgpt: Zero-shot machine-generated text detection using probability curvature, 2023
Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning, and Chelsea Finn · 2023
Cited alongside, same era.
Gpt-4 technical report, 2023
OpenAI · 2023
Cited alongside, same era.
Gptzero: Towards detection of ai-generated text using zero-shot and supervised methods, 2023
Edward Tian and Alexander Cui · 2023
Cited alongside, same era.
Llama: Open and efficient foundation language models, 2023
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample · 2023
Cited alongside, same era.
Incremental verification of neural networks
Shubham Ugare, Debangshu Banerjee, Sasa Misailovic, and Gagandeep Singh · 2023
Cited alongside, same era.
Llmdet: A third party large language models generated text detection tool, 2023
Provable robust watermarking for ai-generated text, 2023
Xuandong Zhao, Prabhanjan Ananth, Lei Li, and Yu-Xiang Wang · 2023
Later among the works it cites.
Universal and transferable adversarial attacks on aligned language models, 2023
Andy Zou, Zifan Wang, Nicholas Carlini, Milad Nasr, J. Zico Kolter, and Matt Fredrikson · 2023
Later among the works it cites.
Relational verification leaps forward with rabbit
Tarun Suresh, Debangshu Banerjee, and Gagandeep Singh · 2024
Closest in time.
Crane: Reasoning with constrained llm generation, 2025
Debangshu Banerjee, Tarun Suresh, Shubham Ugare, Sasa Misailovic, and Gagandeep Singh · 2025
Closest in time.
Swerank: Software issue localization with code ranking, 2025
Revanth Gangi Reddy, Tarun Suresh, JaeHyeok Doo, Ye Liu, Xuan Phi Nguyen, Yingbo Zhou, Semih Yavuz, Caiming Xiong, Heng Ji, and Shafiq Joty · 2025
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Kangxi Wu, Liang Pang, Huawei Shen, Xueqi Cheng, and Tat-Seng Chua · 2023
Cited alongside, same era.
Certified robustness for large language models with self-denoising, 2023
Zhen Zhang, Guanhua Zhang, Bairu Hou, Wenqi Fan, Qing Li, Sijia Liu, Yang Zhang, and Shiyu Chang · 2023
Cited alongside, same era.
A watermark for large language models
John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, and Tom Goldstein
Cited in the paper.
On the reliability of watermarks for large language models, 2023b
John Kirchenbauer, Jonas Geiping, Yuxin Wen, Manli Shu, Khalid Saifullah, Kezhi Kong, Kasun Fernando, Aniruddha Saha, Micah Goldblum, and Tom Goldstein
Cited in the paper.
Cornstack: High-quality contrastive data for better code ranking, 2024b
Tarun Suresh, Revanth Gangi Reddy, Yifei Xu, Zach Nussbaum, Andriy Mulyar, Brandon Duderstadt, and Heng Ji
Cited in the paper.
Itergen: Iterative structured llm generation, 2024a
Shubham Ugare, Rohan Gumaste, Tarun Suresh, Gagandeep Singh, and Sasa Misailovic
Cited in the paper.
Incremental randomized smoothing certification
Shubham Ugare, Tarun Suresh, Debangshu Banerjee, Gagandeep Singh, and Sasa Misailovic
Cited in the paper.
Dingo: Constrained inference for diffusion llms, 2025
Tarun Suresh, Debangshu Banerjee, Shubham Ugare, Sasa Misailovic, and Gagandeep Singh · 2025
Closest in time.
Tamper-resistant safeguards for open-weight llms, 2025
Rishub Tamirisa, Bhrugu Bharathi, Long Phan, Andy Zhou, Alice Gatti, Tarun Suresh, Maxwell Lin, Justin Wang, Rowan Wang, Ron Arel, Andy Zou, Dawn Song, Bo Li, Dan Hendrycks, and Mantas Mazeika · 2025
Closest in time.