Downstream Trade-offs of a Family of Text Watermarks

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Superglue: A stickier benchmark for general-purpose language understanding systems

Original

Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R Bowman. 2019a · 1905

Earlier work this paper cites.

Information Hiding Techniques for Steganography and Digital Watermaking , volume 28

Stephan Katzenbeisser and Fabien Petitcolas. 1999 · 1999

Earlier work this paper cites.

Information hiding-a survey

Fabien A. P. Petitcolas, Ross J. Anderson, and Markus G. Kuhn. 1999 · 1999

Earlier work this paper cites.

Natural language watermarking: Design, analysis, and a proof-of-concept implementation

Mikhail J Atallah, Victor Raskin, Michael Crogan, Christian Hempelmann, Florian Kerschbaum, Dina Mohamed, and Sanket Naik. 2001 · 2001

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

Natural language watermarking using semantic substitution for chinese text

Yuei-Lin Chiang, Lu-Ping Chang, Wen-Tai Hsieh, and Wen-Chih Chen. 2003 · 2003

Earlier work this paper cites.

Natural language watermarking using semantic substitution for chinese text

Yuei-Lin Chiang, Lu-Ping Chang, Wen-Tai Hsieh, and Wen-Chih Chen. 2004 · 2003

Earlier work this paper cites.

Natural language watermarking: Challenges in building a practical system

Mercan Topkara, Giuseppe Riccardi, Dilek Hakkani-Tür, and Mikhail J Atallah. 2006 · 2006

Earlier work this paper cites.

A review of digital watermarking techniques for text documents

Zunera Jalil and Anwar M Mirza. 2009 · 2009

Earlier work this paper cites.

Watermarking the outputs of structured prediction with an application in statistical machine translation

Ashish Venugopal, Jakob Uszkoreit, David Talbot, Franz Josef Och, and Juri Ganitkevitch. 2011 · 2011

Earlier work this paper cites.

Findings of the 2014 workshop on statistical machine translation

Ondrej Bojar, Christian Buck, Christian Federmann, Barry Haddow, Philipp Koehn, Johannes Leveling, Christof Monz, Pavel Pecina, Matt Post, Herve Saint-Amand, Radu Soricut, Lucia Specia, and Ale s Tamchyna. 2014 · 2014

Earlier work this paper cites.

SQuAD: 100,000+ Questions for Machine Comprehension of Text

Original

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Earlier work this paper cites.

Generating steganographic text with LSTMs

Tina Fang, Martin Jaggi, and Katerina Argyraki. 2017 · 2017

Earlier work this paper cites.

DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs

Dheeru Dua, Yizhong Wang, Pradeep Dasigi, Gabriel Stanovsky, Sameer Singh, and Matt Gardner. 2019 · 2019

Earlier work this paper cites.

Hellaswag: Can a machine really finish your sentence?

Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019 · 2019

Earlier work this paper cites.

Findings of the 2020 conference on machine translation (WMT20)

Loïc Barrault, Magdalena Biesialska, Ondřej Bojar, Marta R. Costa-jussà, Christian Federmann, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Matthias Huck, Eric Joanis, Tom Kocmi, Philipp Koehn, Chi-kiu Lo, Nikola Ljubešić, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Santanu Pal, Matt Post, and Marcos Zampieri. 2020 · 2020

Cited alongside, same era.

Piqa: Reasoning about physical commonsense in natural language

Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, and Yejin Choi. 2020 · 2020

Cited alongside, same era.

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020 · 2020

Cited alongside, same era.

Frustratingly easy edit-based linguistic steganography with a masked language model

Original

Honai Ueoka, Yugo Murawaki, and Sadao Kurohashi. 2021 · 2021

Cited alongside, same era.

Palm: Scaling language modeling with pathways

New evaluation metrics capture quality degradation due to llm watermarking

Original

Karanpartap Singh and James Zou. 2023 · 2023

Closest in time.

WatME: Towards lossless watermarking through lexical redundancy

Liang Chen, Yatao Bian, Yang Deng, Deng Cai, Shuaiyi Li, Peilin Zhao, and Kam-Fai Wong. 2024 · 2024

Closest in time.

On the learnability of watermarks for language models

Chenchen Gu, Xiang Lisa Li, Percy Liang, and Tatsunori Hashimoto. 2024 · 2024

Closest in time.

SemStamp: A semantic watermark with paraphrastic robustness for text generation

Abe Hou, Jingyu Zhang, Tianxing He, Yichen Wang, Yung-Sung Chuang, Hongwei Wang, Lingfeng Shen, Benjamin Van Durme, Daniel Khashabi, and Yulia Tsvetkov. 2024 · 2024

Closest in time.

Robust distortion-free watermarks for language models

Rohith Kuditipudi, John Thickstun, Tatsunori Hashimoto, and Percy Liang. 2024 · 2024

Closest in time.