FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge

Wikidata: a free collaborative knowledgebase

Denny Vrandečić and Markus Krötzsch. 2014 · 2014

Earlier work this paper cites.

Not just a black box: Interpretable deep learning by propagating activation differences

Original

Avanti Shrikumar, Peyton Greenside, Anna Shcherbina, and Anshul Kundaje. 2016 · 2016

Earlier work this paper cites.

Large language models sensitivity to the order of options in multiple-choice questions

Pouya Pezeshkpour and Estevam Hruschka. 2024 · 2017

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019

Earlier work this paper cites.

You can teach an old dog new tricks! on training knowledge graph embeddings

Daniel Ruffinelli, Samuel Broscheit, and Rainer Gemulla. 2020 · 2020

Earlier work this paper cites.

Exploring length generalization in large language models

Cem Anil, Yuhuai Wu, Anders Andreassen, Aitor Lewkowycz, Vedant Misra, Vinay Ramasesh, Ambrose Slone, Guy Gur-Ari, Ethan Dyer, and Behnam Neyshabur. 2022 · 2022

Earlier work this paper cites.

When not to trust language models: Investigating effectiveness of parametric and non-parametric memories

Original

Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2022 · 2022

Earlier work this paper cites.

Palm: Scaling language modeling with pathways

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. 2023 · 2023

Earlier work this paper cites.

Shortcut learning of large language models in natural language understanding

Mengnan Du, Fengxiang He, Na Zou, Dacheng Tao, and Xia Hu. 2023 · 2023

Earlier work this paper cites.

Who’s harry potter? approximate unlearning in llms

Original

Ronen Eldan and Mark Russinovich. 2023 · 2023

Earlier work this paper cites.

Knowledge unlearning for mitigating privacy risks in language models

Joel Jang, Dongkeun Yoon, Sohee Yang, Sungmin Cha, Moontae Lee, Lajanugen Logeswaran, and Minjoon Seo. 2023 · 2023

Cited alongside, same era.

Large language models can be lazy learners: Analyze shortcuts in in-context learning

Original

Ruixiang Tang, Dehan Kong, Longtao Huang, and Hui Xue. 2023 · 2023

Cited alongside, same era.

Task-specific compression for multi-task language models using attribution-based pruning

Nakyeong Yang, Yunah Jang, Hwanhee Lee, Seohyeong Jeong, and Kyomin Jung. 2023 · 2023

Cited alongside, same era.

Large language model unlearning

Original

Yuanshun Yao, Xiaojun Xu, and Yang Liu. 2023 · 2023

Cited alongside, same era.

Large language models are not robust multiple choice selectors

Chujie Zheng, Hao Zhou, Fandong Meng, Jie Zhou, and Minlie Huang. 2023 · 2023

Cited alongside, same era.

Gemma 2: Improving open language models at a practical size

Original

Team Gemma, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, et al. 2024 · 2024

Later among the works it cites.

Rwku: Benchmarking real-world knowledge unlearning for large language models

Original

Zhuoran Jin, Pengfei Cao, Chenhao Wang, Zhitao He, Hongbang Yuan, Jiachun Li, Yubo Chen, Kang Liu, and Jun Zhao. 2024 · 2024

Later among the works it cites.

How to turn your knowledge graph embeddings into generative models

Lorenzo Loconte, Nicola Di Mauro, Robert Peharz, and Antonio Vergari. 2024 · 2024

Later among the works it cites.

Tofu: A task of fictitious unlearning for llms

Original

Pratyush Maini, Zhili Feng, Avi Schwarzschild, Zachary C Lipton, and J Zico Kolter. 2024 · 2024

Later among the works it cites.