Has this Fact been Edited? Detecting Knowledge Edits in Language Models

A decision-theoretic generalization of on-line learning and an application to boosting

Yoav Freund and Robert E Schapire. 1997 · 1997

Earlier work this paper cites.

Pattern classification, chapter nonparametric techniques

RO Duda, PE Hart, DG Stork, and Alexandru Ionescu. 2000 · 2000

Earlier work this paper cites.

Zero-shot relation extraction via reading comprehension

Omer Levy, Minjoon Seo, Eunsol Choi, and Luke Zettlemoyer. 2017 · 2017

Earlier work this paper cites.

What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties

Alexis Conneau, German Kruszewski, Guillaume Lample, Loïc Barrault, and Marco Baroni. 2018 · 2018

Earlier work this paper cites.

Language models as knowledge bases?

Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller. 2019 · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019

Earlier work this paper cites.

How much knowledge can you pack into the parameters of a language model?

Adam Roberts, Colin Raffel, and Noam Shazeer. 2020 · 2020

Earlier work this paper cites.

Editing factual knowledge in language models

Nicola De Cao, Wilker Aziz, and Ivan Titov. 2021 · 2021

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

Backdoor attacks on pre-trained models by layerwise weight poisoning

Linyang Li, Demin Song, Xiaonan Li, Jiehang Zeng, Ruotian Ma, and Xipeng Qiu. 2021 · 2021

Earlier work this paper cites.

GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model

Ben Wang and Aran Komatsuzaki. 2021 · 2021

Earlier work this paper cites.

A comparative study of using pre-trained language models for toxic comment classification

Zhixue Zhao, Ziqi Zhang, and Frank Hopfgartner. 2021 · 2021

Earlier work this paper cites.

Transformer-patcher: One mistake worth one neuron

Zeyu Huang, Yikang Shen, Xiaofeng Zhang, Jie Zhou, Wenge Rong, and Zhang Xiong. 2022 · 2022

Earlier work this paper cites.

Locating and editing factual associations in GPT

Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov. 2022 · 2022

Earlier work this paper cites.

GPT-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Stealthy and persistent unalignment on large language models via backdoor injections

Original

Yuanpu Cao, Bochuan Cao, and Jinghui Chen. 2023 · 2023

Earlier work this paper cites.

Decoding the threat landscape: ChatGPT, FraudGPT, and WormGPT in social engineering attacks

Original

Polra Victor Falade. 2023 · 2023

Earlier work this paper cites.

Dissecting recall of factual associations in auto-regressive language models

Mor Geva, Jasmijn Bastings, Katja Filippova, and Amir Globerson. 2023 · 2023

Earlier work this paper cites.

Controllable text generation via probability density estimation in the latent space

Yuxuan Gu, Xiaocheng Feng, Sicheng Ma, Lingyuan Zhang, Heng Gong, Weihong Zhong, and Bing Qin. 2023 · 2023

Cited alongside, same era.

Language models represent space and time

Original

Wes Gurnee and Max Tegmark. 2023 · 2023

Cited alongside, same era.

Aging with grace: Lifelong model editing with discrete key-value adaptors

Thomas Hartvigsen, Swami Sankaranarayanan, Hamid Palangi, Yoon Kim, and Marzyeh Ghassemi. 2023 · 2023

Cited alongside, same era.

Inspecting and editing knowledge representations in language models

Original

Evan Hernandez, Belinda Z Li, and Jacob Andreas. 2023 · 2023

Cited alongside, same era.

Knowledge unlearning for mitigating privacy risks in language models

Joel Jang, Dongkeun Yoon, Sohee Yang, Sungmin Cha, Moontae Lee, Lajanugen Logeswaran, and Minjoon Seo. 2023 · 2023

Cited alongside, same era.

Unlearning bias in language models by partitioning gradients

Charles Yu, Sullam Jeoung, Anish Kasi, Pengfei Yu, and Heng Ji. 2023a · 2023

Later among the works it cites.

Can we edit factual knowledge by in-context learning?

Ce Zheng, Lei Li, Qingxiu Dong, Yuxuan Fan, Zhiyong Wu, Jingjing Xu, and Baobao Chang. 2023 · 2023

Later among the works it cites.

Can editing LLMs inject harm?

Canyu Chen, Baixiang Huang, Zekun Li, Zhaorun Chen, Shiyang Lai, Xiongxiao Xu, Jia-Chen Gu, Jindong Gu, Huaxiu Yao, Chaowei Xiao, Xifeng Yan, William Yang Wang, Philip Torr, Dawn Song, and Kai Shu. 2024 · 2024

Closest in time.

Universal neurons in GPT2 language models

Original

Wes Gurnee, Theo Horsley, Zifan Carl Guo, Tara Rezaei Kheirkhah, Qinyi Sun, Will Hathaway, Neel Nanda, and Dimitris Bertsimas. 2024 · 2024

Closest in time.

" flex tape can’t fix that": Bias and misinformation in edited language models

Original

Karina Halevy, Anna Sotnikova, Badr AlKhamissi, Syrielle Montariol, and Antoine Bosselut. 2024 · 2024