MEOW: MEMOry Supervised LLM Unlearning Via Inverted Facts

Neural text generation with unlikelihood training

Original

Sean Welleck, Ilia Kulikov, Stephen Roller, Emily Dinan, Kyunghyun Cho, and Jason Weston. 2019 · 1908

Earlier work this paper cites.

Eternal sunshine of the spotless net: Selective forgetting in deep networks

Original

Aditya Golatkar, Alessandro Achille, and Stefano Soatto. 2020 · 1911

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation

Kishore Papineni, Salim Roukos, Todd Ward, and Wei jing Zhu. 2002 · 2002

Earlier work this paper cites.

ROUGE: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

Scanning electronic documents for personally identifiable information

Tuomas Aura, Thomas A. Kuhn, and Michael Roe. 2006 · 2006

Earlier work this paper cites.

Calibrating noise to sensitivity in private data analysis

Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam Smith. 2006 · 2006

Earlier work this paper cites.

The Handbook of Information and Computer Ethics

K. E. Himma. 2007 · 2007

Earlier work this paper cites.

Descent-to-delete: Gradient-based methods for machine unlearning

Original

Seth Neel, Aaron Roth, and Saeed Sharifi-Malvajerdi. 2020 · 2007

Earlier work this paper cites.

Differential privacy: A survey of results

Cynthia Dwork. 2008 · 2008

Earlier work this paper cites.

Extracting training data from large language models

Original

Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, Alina Oprea, and Colin Raffel. 2021 · 2012

Earlier work this paper cites.

Federated unlearning

Original

Gaoyang Liu, Xiaoqiang Ma, Yang Yang, Chen Wang, and Jiangchuan Liu. 2021 · 2012

Earlier work this paper cites.

Towards making systems forget with machine unlearning

Yinzhi Cao and Junfeng Yang. 2015 · 2015

Earlier work this paper cites.

Deep learning with differential privacy

Martin Abadi, Andy Chu, Ian Goodfellow, H. Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang. 2016 · 2016

Earlier work this paper cites.

De-identification of patient notes with recurrent neural networks

Original

Franck Dernoncourt, Ji Young Lee, Ozlem Uzuner, and Peter Szolovits. 2016 · 2016

Earlier work this paper cites.

Pointer sentinel mixture models

Original

Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. 2016 · 2016

Earlier work this paper cites.

General data protection regulation (GDPR)

European Parliament and Council of the European Union. 2016 · 2016

Earlier work this paper cites.

news-please: A generic news crawler and extractor

Felix Hamborg, Norman Meuschke, Corinna Breitinger, and Bela Gipp. 2017 · 2017

Earlier work this paper cites.

Membership inference attacks against machine learning models

Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov. 2017 · 2017

Earlier work this paper cites.

Think you have solved question answering? try arc, the ai2 reasoning challenge

Original

Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018 · 2018

Earlier work this paper cites.

The secret sharer: Evaluating and testing unintended memorization in neural networks

Original

Nicholas Carlini, Chang Liu, Úlfar Erlingsson, Jernej Kos, and Dawn Song. 2019 · 2019

Earlier work this paper cites.

Making ai forget you: Data deletion in machine learning

Antonio Ginart, Melody Guan, Gregory Valiant, and James Y Zou. 2019 · 2019

Earlier work this paper cites.

Piqa: Reasoning about physical commonsense in natural language

Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, and Yejin Choi. 2020 · 2020

Earlier work this paper cites.

Large-scale differentially private bert

Original

Rohan Anil, Badih Ghazi, Vineet Gupta, Ravi Kumar, and Pasin Manurangsi. 2021 · 2021

Cited alongside, same era.

Anonymisation models for text data: State of the art, challenges and future directions

Pierre Lison, Ildikó Pilán, David Sanchez, Montserrat Batet, and Lilja Øvrelid. 2021 · 2021

Cited alongside, same era.

Mauve: Measuring the gap between neural text and human text using divergence frontiers

Original

Krishna Pillutla, Swabha Swayamdipta, Rowan Zellers, John Thickstun, Sean Welleck, Yejin Choi, and Zaid Harchaoui. 2021 · 2021

Cited alongside, same era.

Remember what you want to forget: Algorithms for machine unlearning

Original

Ayush Sekhari, Jayadev Acharya, Gautam Kamath, and Ananda Theertha Suresh. 2021 · 2021

Cited alongside, same era.

Machine unlearning via algorithmic stability

Use of llms for illicit purposes: Threats, prevention measures, and vulnerabilities

Original

Maximilian Mozes, Xuanli He, Bennett Kleinberg, and Lewis D. Griffin. 2023 · 2023

Later among the works it cites.

Scalable extraction of training data from (production) language models

Original

Milad Nasr, Nicholas Carlini, Jonathan Hayase, Matthew Jagielski, A. Feder Cooper, Daphne Ippolito, Christopher A. Choquette-Choo, Eric Wallace, Florian Tramèr, and Katherine Lee. 2023 · 2023

Later among the works it cites.

Knowledge unlearning for llms: Tasks, methods, and challenges

Original

Nianwen Si, Hao Zhang, Heyu Chang, Wenlin Zhang, Dan Qu, and Weiqiang Zhang. 2023 · 2023

Later among the works it cites.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. 2023 · 2023