PostMark: A Robust Blackbox Watermark for Large Language Models

Electronic marking and identification techniques to discourage document copying

J.T. Brassil, S. Low, N.F. Maxemchuk, and L. O’Gorman. 1995 · 1995

Earlier work this paper cites.

Document identification for copyright protection using centroid detection

S.H. Low, N.F. Maxemchuk, and A.M. Lapone. 1998 · 1998

Earlier work this paper cites.

Natural language watermarking: Design, analysis, and a proof-of-concept implementation

Mikhail J. Atallah, Victor Raskin, Michael Crogan, Christian Hempelmann, Florian Kerschbaum, Dina Mohamed, and Sanket Naik. 2001 · 2001

Earlier work this paper cites.

Natural language watermarking and tamperproofing

Mikhail J. Atallah, Victor Raskin, Christian F. Hempelmann, Mercan Karahan, Radu Sion, Umut Topkara, and Katrina E. Triezenberg. 2003 · 2003

Earlier work this paper cites.

The hiding virtues of ambiguity: quantifiably resilient watermarking of natural language text through synonym substitutions

Umut Topkara, Mercan Topkara, and Mikhail J. Atallah. 2006 · 2006

Earlier work this paper cites.

Adversarial watermarking transformer: Towards tracing text provenance with data hiding

Original

Sahar Abdelnabi and Mario Fritz. 2021 · 2009

Earlier work this paper cites.

Natural language watermarking via morphosyntactic alterations

Hasan Mesut Meral, Bülent Sankur, A. Sumru Özsoy, Tunga Güngör, and Emre Sevinç. 2009 · 2009

Earlier work this paper cites.

Watermarking the outputs of structured prediction with an application in statistical machine translation

Ashish Venugopal, Jakob Uszkoreit, David Talbot, Franz Och, and Juri Ganitkevitch. 2011 · 2011

Earlier work this paper cites.

From paraphrase database to compositional paraphrase model and back

John Wieting, Mohit Bansal, Kevin Gimpel, and Karen Livescu. 2015 · 2015

Earlier work this paper cites.

Generating steganographic text with LSTMs

Tina Fang, Martin Jaggi, and Katerina Argyraki. 2017 · 2017

Earlier work this paper cites.

Pointer sentinel mixture models

Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. 2017 · 2017

Earlier work this paper cites.

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020 · 2020

Earlier work this paper cites.

Meteor: Cryptographically secure steganography for realistic distributions

Gabriel Kaptchuk, Tushar M. Jois, Matthew Green, and Aviel D. Rubin. 2021 · 2021

Earlier work this paper cites.

Ethical and social risks of harm from language models

Original

Laura Weidinger, John Mellor, Maribeth Rauh, Conor Griffin, Jonathan Uesato, Po-Sen Huang, Myra Cheng, Mia Glaese, Borja Balle, Atoosa Kasirzadeh, Zac Kenton, Sasha Brown, Will Hawkins, Tom Stepleton, Courtney Biles, Abeba Birhane, Julia Haas, Laura Rimell, Lisa Anne Hendricks, William Isaac, Sean Legassick, Geoffrey Irving, and Iason Gabriel. 2021 · 2021

Earlier work this paper cites.

Watermarking gpt outputs

Scott Aaronson and Hendrik Kirchner. 2022 · 2022

Earlier work this paper cites.

Training a helpful and harmless assistant with reinforcement learning from human feedback

Original

Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, Nicholas Joseph, Saurav Kadavath, Jackson Kernion, Tom Conerly, Sheer El-Showk, Nelson Elhage, Zac Hatfield-Dodds, Danny Hernandez, Tristan Hume, Scott Johnston, Shauna Kravec, Liane Lovitt, Neel Nanda, Catherine Olsson, Dario Amodei, Tom Brown, Jack Clark, Sam McCandlish, Chris Olah, Ben Mann, and Jared Kaplan. 2022 · 2022

Earlier work this paper cites.

Perplexity from plm is unreliable for evaluating text quality

Yequan Wang, Jiawen Deng, Aixin Sun, and Xuying Meng. 2022 · 2022

Earlier work this paper cites.

Opt: Open pre-trained transformer language models

Original

Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, and Luke Zettlemoyer. 2022 · 2022

Cited alongside, same era.

Undetectable watermarks for language models

Original

Miranda Christ, Sam Gunn, and Or Zamir. 2023 · 2023

Cited alongside, same era.

Redpajama: an open dataset for training large language models

Together Computer. 2023 · 2023

Cited alongside, same era.

Semstamp: A semantic watermark with paraphrastic robustness for text generation

Original

Abe Bohan* Hou, Jingyu* Zhang, Tianxing* He, Yung-Sung Chuang, Hongwei Wang, Lingfeng Shen, Benjamin Van Durme, Daniel Khashabi, and Yulia Tsvetkov. 2023 · 2023

Cited alongside, same era.

Judging llm-as-a-judge with mt-bench and chatbot arena

Original

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023 · 2023

Later among the works it cites.

Llama 3 model card

AI@Meta. 2024 · 2024

Closest in time.

Can watermarks survive translation? on the cross-lingual consistency of text watermark for large language models

Original

Zhiwei He, Binglin Zhou, Hongkun Hao, Aiwei Liu, Xing Wang, Zhaopeng Tu, Zhuosheng Zhang, and Rui Wang. 2024 · 2024

Closest in time.

k-semstamp: A clustering-based semantic watermark for detection of machine-generated text

Original

Abe Bohan Hou, Jingyu Zhang, Yichen Wang, Daniel Khashabi, and Tianxing He. 2024 · 2024

Closest in time.

Unbiased watermark for large language models

Zhengmian Hu, Lichang Chen, Xidong Wu, Yihan Wu, Hongyang Zhang, and Heng Huang. 2024 · 2024