Towards Robust Knowledge Unlearning: An Adversarial Framework for Assessing and Improving Unlearning Robustness in Large Language Models

ROUGE: A Package for Automatic Evaluation of Summaries

Lin, C.-Y. 2004 · 2004

Earlier work this paper cites.

Corrigendum to ”The EU Proposal for a General Data Protection Regulation and the roots of the ’right to be forgotten’” [2013] 29 CLSR 229-235

Mantelero, A. 2013 · 2013

Earlier work this paper cites.

Sparks of Artificial General Intelligence: Early experiments with GPT-4

Original

Bubeck, S.; Chandrasekaran, V.; Eldan, R.; Gehrke, J.; Horvitz, E.; Kamar, E.; Lee, P.; Lee, Y. T.; Li, Y.; Lundberg, S.; Nori, H.; Palangi, H.; Ribeiro, M. T.; and Zhang, Y. 2023 · 2023

Earlier work this paper cites.

Are aligned neural networks adversarially aligned?

Carlini, N.; Nasr, M.; Choquette-Choo, C. A.; Jagielski, M.; Gao, I.; Koh, P. W.; Ippolito, D.; Tramèr, F.; and Schmidt, L. 2023 · 2023

Earlier work this paper cites.

Unlearn What You Want to Forget: Efficient Unlearning for LLMs

Chen, J.; and Yang, D. 2023 · 2023

Earlier work this paper cites.

Who’s Harry Potter? Approximate Unlearning in LLMs

Original

Eldan, R.; and Russinovich, M. 2023 · 2023

Earlier work this paper cites.

Knowledge Unlearning for Mitigating Privacy Risks in Language Models

Jang, J.; Yoon, D.; Yang, S.; Cha, S.; Lee, M.; Logeswaran, L.; and Seo, M. 2023 · 2023

Earlier work this paper cites.

Model Sparsity Can Simplify Machine Unlearning

Jia, J.; Liu, J.; Ram, P.; Yao, Y.; Liu, G.; Liu, Y.; Sharma, P.; and Liu, S. 2023 · 2023

Earlier work this paper cites.

Automatically Auditing Large Language Models via Discrete Optimization

Jones, E.; Dragan, A. D.; Raghunathan, A.; and Steinhardt, J. 2023 · 2023

Earlier work this paper cites.

Open Sesame! Universal Black Box Jailbreaking of Large Language Models

Original

Lapid, R.; Langberg, R.; and Sipper, M. 2023 · 2023

Earlier work this paper cites.

Llama 2: Open Foundation and Fine-Tuned Chat Models

Original

Touvron, H.; Martin, L.; Stone, K.; Albert, P.; Almahairi, A.; Babaei, Y.; Bashlykov, N.; Batra, S.; Bhargava, P.; Bhosale, S.; Bikel, D.; Blecher, L.; Ferrer, C. C.; Chen, M.; Cucurull, G.; Esiobu, D.; Fernandes, J.; Fu, J.; Fu, W.; Fuller, B.; Gao, C.; Goswami, V.; Goyal, N.; Hartshorn, A.; Hosseini, S.; Hou, R.; Inan, H.; Kardas, M.; Kerkez, V.; Khabsa, M.; Kloumann, I.; Korenev, A.; Koura, P. S.; Lachaux, M.-A.; Lavril, T.; Lee, J.; Liskovich, D.; Lu, Y.; Mao, Y.; Martinet, X.; Mihaylov, T.; Mishra, P.; Molybog, I.; Nie, Y.; Poulton, A.; Reizenstein, J.; Rungta, R.; Saladi, K.; Schelten, A.; Silva, R.; Smith, E. M.; Subramanian, R.; Tan, X. E.; Tang, B.; Taylor, R.; Williams, A.; Kuan, J. X.; Xu, P.; Yan, Z.; Zarov, I.; Zhang, Y.; Fan, A.; Kambadur, M.; Narang, S.; Rodriguez, A.; Stojnic, R.; Edunov, S.; and Scialom, T. 2023 · 2023

Cited alongside, same era.

Jailbroken: How Does LLM Safety Training Fail?

Wei, A.; Haghtalab, N.; and Steinhardt, J. 2023 · 2023

Cited alongside, same era.

DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models

Wu, X.; Li, J.; Xu, M.; Dong, W.; Wu, S.; Bian, C.; and Xiong, D. 2023 · 2023

Cited alongside, same era.

Defending Against Unforeseen Failure Modes with Latent Adversarial Training

Original

Casper, S.; Schulze, L.; Patel, O.; and Hadfield-Menell, D. 2024 · 2024

TOFU: A Task of Fictitious Unlearning for LLMs

Original

Maini, P.; Feng, Z.; Schwarzschild, A.; Lipton, Z. C.; and Kolter, J. Z. 2024 · 2024

Closest in time.

Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attacks

Patil, V.; Hase, P.; and Bansal, M. 2024 · 2024

Closest in time.

AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs

Original

Paulus, A.; Zharmagambetov, A.; Guo, C.; Amos, B.; and Tian, Y. 2024 · 2024

Closest in time.

MUSE: Machine Unlearning Six-Way Evaluation for Language Models

Original

Shi, W.; Lee, J.; Huang, Y.; Malladi, S.; Zhao, J.; Holtzman, A.; Liu, D.; Zettlemoyer, L.; Smith, N. A.; and Zhang, C. 2024 · 2024

Closest in time.

UnUnlearning: Unlearning is not sufficient for content regulation in advanced generative AI