Fetching the paper…
Reading the bibliography…
We propose a methodology for planting watermarks in text from an autoregressive language model that are robust to perturbations without changing the distribution over text up to a certain maximum generation budget.
Vol. 2. probability and statistics, General
G. Elfving, G. Birkhoff, and R. von Mises · 1966
Earlier work this paper cites.
Digital watermarking
S. Katzenbeisser and F. Petitcolas · 2000
Earlier work this paper cites.
Natural language watermarking: Design, analysis, and a proof-of-concept implementation
M. J. Atallah, V. Raskin, M. Crogan, C. Hempelmann, F. Kerschbaum, D. Mohamed, and S. Naik · 2001
Earlier work this paper cites.
Perturb-and-map random fields: Using discrete optimization to learn and sample from energy models
G. Papandreou and A. L. Yuille · 2011
Earlier work this paper cites.
Watermarking the outputs of structured prediction with an application in statistical machine translation
A. Venugopal, J. Uszkoreit, D. Talbot, F. J. Och, and J. Ganitkevitch · 2011
Earlier work this paper cites.
A review of text watermarking: theory, methods, and applications
N. S. Kamaruddin, A. Kamsin, L. Y. Por, and H. Rahman · 2018
Earlier work this paper cites.
Towards near-imperceptible steganographic text
F. Dai and Z. Cai · 2019
Earlier work this paper cites.
Fine-grain watermarking for intellectual property protection
S. G. Rizzo, F. Bertini, and D. Montesi · 2019
Earlier work this paper cites.
High-Dimensional Statistics: A Non-Asymptotic Viewpoint
M. J. Wainwright · 2019
Earlier work this paper cites.
Neural linguistic steganography
Z. Ziegler, Y. Deng, and A. M. Rush · 2019
Earlier work this paper cites.
Language models are few-shot learners
T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, et al · 2020
Cited alongside, same era.
Automatic detection of machine generated text: A critical survey
G. Jawahar, M. Abdul-Mageed, and V. Laks Lakshmanan · 2020
Cited alongside, same era.
Exploring the limits of transfer learning with a unified text-to-text transformer
C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu · 2020
Cited alongside, same era.
Near-imperceptible neural linguistic steganography via self-adjusting arithmetic coding
J. Shen, H. Ji, and J. Han · 2020
Cited alongside, same era.
OPUS-MT — Building open translation services for the World
J. Tiedemann and S. Thottingal · 2020
Cited alongside, same era.
Adversarial watermarking transformer: Towards tracing text provenance with data hiding
Tracing text provenance via context-aware lexical substitution
X. Yang, J. Zhang, K. Chen, W. Zhang, Z. Ma, F. Wang, and N. Yu · 2022
Later among the works it cites.
Opt: Open pre-trained transformer language models
S. Zhang, S. Roller, N. Goyal, M. Artetxe, M. Chen, S. Chen, C. Dewan, M. Diab, X. Li, X. V. Lin, et al · 2022
Later among the works it cites.
‘Reform’ AI Alignment with Scott Aaronson
S. Aaronson · 2023
Closest in time.
Undetectable watermarks for language models
M. Christ, S. Gunn, and O. Zamir · 2023
Closest in time.
A watermark for large language models
J. Kirchenbauer, J. Geiping, Y. Wen, J. Katz, I. Miers, and T. Goldstein · 2023
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
S. Abdelnabi and M. Fritz · 2021
Cited alongside, same era.
Frustratingly easy edit-based linguistic steganography with a masked language model
H. Ueoka, Y. Murawaki, and S. Kurohashi · 2021
Cited alongside, same era.
Democratizing machine translation with opus-mt
J. Tiedemann, M. Aulamo, D. Bakshandaeva, M. Boggia, S.-A. Grönroos, T. Nieminen, A. Raganato, Y. Scherrer, R. Vazquez, and S. Virpioja · 2022
Cited alongside, same era.
AI-generated answers temporarily banned on coding Q&A site Stack Overflow
J. Vincent · 2022
Cited alongside, same era.
Protecting intellectual property of language generation APIs with lexical watermark
X. He, Q. Xu, L. Lyu, F. Wu, and C. Wang
Cited in the paper.
Cater: Intellectual property protection on text generation apis via conditional watermarks
X. He, Q. Xu, Y. Zeng, L. Lyu, F. Wu, J. Li, and R. Jia
Cited in the paper.
E. Mitchell, Y. Lee, A. Khazatsky, C. D. Manning, and C. Finn · 2023
Closest in time.
Stanford alpaca: An instruction-following llama model
R. Taori, I. Gulrajani, T. Zhang, Y. Dubois, X. Li, C. Guestrin, P. Liang, and T. B. Hashimoto · 2023
Closest in time.
Llama: Open and efficient foundation language models
H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar, et al · 2023
Closest in time.
Protecting language generation models via invisible watermarking
X. Zhao, Y.-X. Wang, and L. Li · 2023
Closest in time.