Unveiling Entity-Level Unlearning for Large Language Models: A Comprehensive Analysis

Bertscore: Evaluating text generation with bert

Original

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019 · 1904

Earlier work this paper cites.

Rouge: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

Towards making systems forget with machine unlearning

Yinzhi Cao and Junfeng Yang. 2015 · 2015

Earlier work this paper cites.

Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension

Original

Mandar Joshi, Eunsol Choi, Daniel S Weld, and Luke Zettlemoyer. 2017 · 2017

Earlier work this paper cites.

Training a helpful and harmless assistant with reinforcement learning from human feedback

Original

Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, et al. 2022 · 2022

Earlier work this paper cites.

Knowledge unlearning for mitigating privacy risks in language models

Original

Joel Jang, Dongkeun Yoon, Sohee Yang, Sungmin Cha, Moontae Lee, Lajanugen Logeswaran, and Minjoon Seo. 2022 · 2022

Earlier work this paper cites.

Continual learning and private unlearning

Bo Liu, Qiang Liu, and Peter Stone. 2022 · 2022

Earlier work this paper cites.

Quark: Controllable text generation with reinforced unlearning

Ximing Lu, Sean Welleck, Jack Hessel, Liwei Jiang, Lianhui Qin, Peter West, Prithviraj Ammanabrolu, and Yejin Choi. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Identifying and mitigating the security risks of generative ai

Clark Barrett, Brad Boyd, Elie Bursztein, Nicholas Carlini, Brad Chen, Jihye Choi, Amrita Roy Chowdhury, Mihai Christodorescu, Anupam Datta, Soheil Feizi, et al. 2023 · 2023

Earlier work this paper cites.

Unlearn what you want to forget: Efficient unlearning for llms

Original

Jiaao Chen and Diyi Yang. 2023 · 2023

Earlier work this paper cites.

Trends in integration of knowledge and large language models: A survey and taxonomy of methods, benchmarks, and applications

Original

Zhangyin Feng, Weitao Ma, Weijiang Yu, Lei Huang, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, et al. 2023 · 2023

Earlier work this paper cites.

A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions

Original

Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, et al. 2023 · 2023

Earlier work this paper cites.

Evaluating open-domain question answering in the era of large language models

Original

Ehsan Kamalloo, Nouha Dziri, Charles LA Clarke, and Davood Rafiei. 2023 · 2023

Cited alongside, same era.

Copyright violations and large language models

Original

Antonia Karamolegkou, Jiaang Li, Li Zhou, and Anders Søgaard. 2023 · 2023

Cited alongside, same era.

Textbooks are all you need ii: phi-1.5 technical report

Original

Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, and Yin Tat Lee. 2023 · 2023

Cited alongside, same era.

Can sensitive information be deleted from llms? objectives for defending against extraction attacks

Vaidehi Patil, Peter Hase, and Mohit Bansal. 2023 · 2023

Cited alongside, same era.

Detecting pretraining data from large language models

Does fine-tuning llms on new knowledge encourage hallucinations?

Original

Zorik Gekhman, Gal Yona, Roee Aharoni, Matan Eyal, Amir Feder, Roi Reichart, and Jonathan Herzig. 2024 · 2024

Closest in time.

Offset unlearning for large language models

Original

James Y Huang, Wenxuan Zhou, Fei Wang, Fred Morstatter, Sheng Zhang, Hoifung Poon, and Muhao Chen. 2024 · 2024

Closest in time.

Beavertails: Towards improved safety alignment of llm via a human-preference dataset

Jiaming Ji, Mickel Liu, Josef Dai, Xuehai Pan, Chi Zhang, Ce Bian, Boyuan Chen, Ruiyang Sun, Yizhou Wang, and Yaodong Yang. 2024 · 2024

Closest in time.

Rwku: Benchmarking real-world knowledge unlearning for large language models

Original

Zhuoran Jin, Pengfei Cao, Chenhao Wang, Zhitao He, Hongbang Yuan, Jiachun Li, Yubo Chen, Kang Liu, and Jun Zhao. 2024 · 2024

Closest in time.

The wmdp benchmark: Measuring and reducing malicious use with unlearning