A Survey of Text Watermarking in the Era of Large Language Models

Large language models in medicine

Arun James Thirunavukarasu, Darren Shu Jeng Ting, Kabilan Elangovan, Laura Gutierrez, Ting Fang Tan, and Daniel Shu Wei Ting. 2023 · 1940

Earlier work this paper cites.

A robust digital watermarking algorithm for text document copyright protection based on feature coding. In

Muhammad Munwar Iqbal, Umair Khadam, Ki Jun Han, Jihun Han, and Sohail Jabbar. 2019 · 1945

Earlier work this paper cites.

Electronic marking and identification techniques to discourage document copying

Jack T Brassil, Steven Low, Nicholas F. Maxemchuk, and Lawrence O’Gorman. 1995 · 1995

Earlier work this paper cites.

WordNet: An electronic lexical database

Christiane Fellbaum. 1998 · 1998

Earlier work this paper cites.

Natural language watermarking: Design, analysis, and a proof-of-concept implementation. In

Mikhail J Atallah, Victor Raskin, Michael Crogan, Christian Hempelmann, Florian Kerschbaum, Dina Mohamed, and Sanket Naik. 2001 · 2001

Earlier work this paper cites.

The homograph attack

Evgeniy Gabrilovich and Alex Gontmakher. 2002 · 2002

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation. In

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

Bad characters: Imperceptible nlp attacks. In

Nicholas Boucher, Ilia Shumailov, Ross Anderson, and Nicolas Papernot. 2022 · 2004

Earlier work this paper cites.

METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In

Satanjeev Banerjee and Alon Lavie. 2005 · 2005

Earlier work this paper cites.

Natural language watermarking via morphosyntactic alterations

Hasan Mesut Meral, Bülent Sankur, A Sumru Özsoy, Tunga Güngör, and Emre Sevinç. 2009 · 2009

Earlier work this paper cites.

UniSpaCh: A text-based data hiding method using Unicode space characters

Lip Yee Por, KokSheik Wong, and Kok Onn Chee. 2012 · 2012

Earlier work this paper cites.

Copyright for web content using invisible text watermarking

Nighat Mir. 2014 · 2014

Earlier work this paper cites.

Concise analysis of current text automation and watermarking approaches

Mohammed Hazim Alkawaz, Ghazali Sulong, Tanzila Saba, Abdulaziz S Almazyad, and Amjad Rehman. 2016 · 2016

Earlier work this paper cites.

Content-preserving text watermarking through unicode homoglyph substitution. In

Stefano Giovanni Rizzo, Flavio Bertini, and Danilo Montesi. 2016 · 2016

Earlier work this paper cites.

Categorical Reparameterization with Gumbel-Softmax. In

Eric Jang, Shixiang Gu, and Ben Poole. 2017 · 2017

Earlier work this paper cites.

Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension

Original

Mandar Joshi, Eunsol Choi, Daniel S Weld, and Luke Zettlemoyer. 2017 · 2017

Earlier work this paper cites.

Embedding watermarks into deep neural networks. In

Yusuke Uchida, Yuki Nagai, Shigeyuki Sakazawa, and Shin’ichi Satoh. 2017 · 2017

Earlier work this paper cites.

Universal sentence encoder

Original

Daniel Cer, Yinfei Yang, Sheng-yi Kong, Nan Hua, Nicole Limtiaco, Rhomni St John, Noah Constant, Mario Guajardo-Cespedes, Steve Yuan, Chris Tar, et al · 2018

Earlier work this paper cites.

Understanding Back-Translation at Scale. In

Sergey Edunov, Myle Ott, Michael Auli, and David Grangier. 2018 · 2018

Earlier work this paper cites.

A review of text watermarking: theory, methods, and applications

Nurul Shamimi Kamaruddin, Amirrudin Kamsin, Lip Yee Por, and Hameedur Rahman. 2018 · 2018

Earlier work this paper cites.

Improving language understanding by generative pre-training

Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al · 2018

Earlier work this paper cites.

A comparative analysis of information hiding techniques for copyright protection of text documents

Milad Taleby Ahvanooey, Qianmu Li, Hiuk Jae Shim, and Yanyan Huang. 2018 · 2018

Earlier work this paper cites.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

ELI5: Long Form Question Answering. In

Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, and Michael Auli. 2019 · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al · 2019

Earlier work this paper cites.

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In

Nils Reimers and Iryna Gurevych. 2019 · 2019

Earlier work this paper cites.

Digital image watermarking techniques: a review

Mahbuba Begum and Mohammad Shorif Uddin. 2020 · 2020

Earlier work this paper cites.

The Curious Case of Neural Text Degeneration. In

Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2020 · 2020

Earlier work this paper cites.

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020

Earlier work this paper cites.

Unsupervised text generation by learning from search

Jingjing Li, Zichao Li, Lili Mou, Xin Jiang, Michael Lyu, and Irwin King. 2020 · 2020

Earlier work this paper cites.

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020

Earlier work this paper cites.

Incorporating bert into neural machine translation

Original

Jinhua Zhu, Yingce Xia, Lijun Wu, Di He, Tao Qin, Wengang Zhou, Houqiang Li, and Tie-Yan Liu. 2020 · 2020

Earlier work this paper cites.

Adversarial watermarking transformer: Towards tracing text provenance with data hiding. In

Sahar Abdelnabi and Mario Fritz. 2021 · 2021

Earlier work this paper cites.

Evaluating large language models trained on code

Original

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde De Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al · 2021

Earlier work this paper cites.

Truthfulqa: Measuring how models mimic human falsehoods

Original

Stephanie Lin, Jacob Hilton, and Owain Evans. 2021 · 2021

Earlier work this paper cites.

DISSIMILAR: Towards fake news detection using information hiding, signal processing and machine learning. In

David Megías, Minoru Kuribayashi, Andrea Rosales, and Wojciech Mazurczyk. 2021 · 2021

Earlier work this paper cites.

Review of the Literature on the Steganography Concept

Fatih Şahin, Taner Çevik, and Mustafa Takaoğlu. 2021 · 2021

Earlier work this paper cites.

Watermarking GPT outputs

S. Aaronson and H. Kirchner. 2022 · 2022

Earlier work this paper cites.

No language left behind: Scaling human-centered machine translation

Original

Marta R Costa-jussà, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, et al · 2022

Earlier work this paper cites.

Cater: Intellectual property protection on text generation apis via conditional watermarks

Xuanli He, Qiongkai Xu, Yi Zeng, Lingjuan Lyu, Fangzhao Wu, Jiwei Li, and Ruoxi Jia. 2022b · 2022

Earlier work this paper cites.

Text Revision by On-the-Fly Representation Optimization

Jingjing Li, Zichao Li, Tao Ge, Irwin King, and Michael R Lyu. 2022 · 2022

Earlier work this paper cites.

PanGu-Bot: Efficient Generative Dialogue Pre-training from Pre-trained Language Model

Original

Fei Mi, Yitong Li, Yulong Zeng, Jingyan Zhou, Yasheng Wang, Chuanfei Xu, Lifeng Shang, Xin Jiang, Shiqi Zhao, and Qun Liu. 2022 · 2022

Cited alongside, same era.

Red Teaming Language Models with Language Models. In

Ethan Perez, Saffron Huang, Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving. 2022 · 2022

Cited alongside, same era.

Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completion. In

Kurt Shuster, Mojtaba Komeili, Leonard Adolphs, Stephen Roller, Arthur Szlam, and Jason Weston. 2022 · 2022

Cited alongside, same era.

Coprotector: Protect open-source code against unauthorized training usage with data poisoning. In

Zhensu Sun, Xiaoning Du, Fu Song, Mingze Ni, and Li Li. 2022 · 2022

Cited alongside, same era.

Lamda: Language models for dialog applications

Original

Advancing Beyond Identification: Multi-bit Watermark for Language Models

Original

KiYoon Yoo, Wonhyuk Ahn, and Nojun Kwak. 2023a · 2023

Closest in time.

REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Models

Original

Ruisi Zhang, Shehzeen Samarah Hussain, Paarth Neekhara, and Farinaz Koushanfar. 2023 · 2023

Closest in time.

Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human Solutions. In

Jiawei Zhou, Yixuan Zhang, Qianni Luo, Andrea G Parker, and Munmun De Choudhury. 2023 · 2023

Closest in time.

Can LLM-Generated Misinformation Be Detected?. In

Canyu Chen and Kai Shu. 2024 · 2024

Closest in time.

Undetectable watermarks for language models. In

Miranda Christ, Sam Gunn, and Or Zamir. 2024 · 2024

Closest in time.