Fetching the paper…
Reading the bibliography…
The imperative task of revising or updating the knowledge stored within large language models arises from two distinct sources: intrinsic errors inherent in the model which should be corrected and outdated knowledge due to external shifts in the real world which should be updated.
Language Models as Knowledge Bases?
Petroni, F.; Rocktäschel, T.; Lewis, P.; Bakhtin, A.; Wu, Y.; Miller, A. H.; and Riedel, S. 2019b · 1909
Earlier work this paper cites.
Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit
Hahnloser, R.; Sarpeshkar, R.; Mahowald, M.; Douglas, R.; and Seung, H. 2000 · 2000
Earlier work this paper cites.
Language Models are Few-Shot Learners
Brown, T. B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; Agarwal, S.; Herbert-Voss, A.; Krueger, G.; Henighan, T.; Child, R.; Ramesh, A.; Ziegler, D. M.; Wu, J.; Winter, C.; Hesse, C.; Chen, M.; Sigler, E.; Litwin, M.; Gray, S.; Chess, B.; Clark, J.; Berner, C.; McCandlish, S.; Radford, A.; Sutskever, I.; and Amodei, D. 2020 · 2005
Earlier work this paper cites.
HyTE: Hyperplane-based Temporally aware Knowledge Graph Embedding
Dasgupta, S. S.; Ray, S. N.; and Talukdar, P. 2018 · 2011
Earlier work this paper cites.
Modifying Memories in Transformer Models
Zhu, C.; Rawat, A. S.; Zaheer, M.; Bhojanapalli, S.; Li, D.; Yu, F.; and Kumar, S. 2020 · 2012
Earlier work this paper cites.
Translating embeddings for modeling multi-relational data
Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; and Yakhnenko, O. 2013 · 2013
Earlier work this paper cites.
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y.; Liu, Z.; Sun, M.; Liu, Y.; and Zhu, X. 2015 · 2015
Earlier work this paper cites.
YAGO3: A Knowledge Base from Multilingual Wikipedias
Mahdisoltani, F.; Biega, J. A.; and Suchanek, F. M. 2015 · 2015
Earlier work this paper cites.
Commonsense Knowledge Mining from Pretrained Models
Davison, J.; Feldman, J.; and Rush, A. 2019 · 2019
Earlier work this paper cites.
Language Models as Knowledge Bases?
Petroni, F.; Rocktäschel, T.; Riedel, S.; Lewis, P.; Bakhtin, A.; Wu, Y.; and Miller, A. 2019a · 2019
Earlier work this paper cites.
Correcting deep neural networks with small, generalizing patches
Sotoudeh, M.; and Thakur, A. 2019 · 2019
Cited alongside, same era.
Editable Neural Networks
Sinitsin, A.; Plokhotnyuk, V.; Pyrkin, D. V.; Popov, S.; and Babenko, A. 2020 · 2020
Cited alongside, same era.
Editing Factual Knowledge in Language Models
Cao, N. D.; Aziz, W.; and Titov, I. 2021 · 2021
Cited alongside, same era.
Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs
Hase, P.; Diab, M.; Celikyilmaz, A.; Li, X.; Kozareva, Z.; Stoyanov, V.; Bansal, M.; and Iyer, S. 2021 · 2021
Cited alongside, same era.
GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model
Wang, B.; and Komatsuzaki, A. 2021 · 2021
Cited alongside, same era.
Training language models to follow instructions with human feedback
Ouyang, L.; Wu, J.; Jiang, X.; Almeida, D.; Wainwright, C. L.; Mishkin, P.; Zhang, C.; Agarwal, S.; Slama, K.; Ray, A.; Schulman, J.; Hilton, J.; Kelton, F.; Miller, L.; Simens, M.; Askell, A.; Welinder, P.; Christiano, P.; Leike, J.; and Lowe, R. 2022 · 2022
Later among the works it cites.
Evaluating the Ripple Effects of Knowledge Editing in Language Models
Cohen, R.; Biran, E.; Yoran, O.; Globerson, A.; and Geva, M. 2023 · 2023
Closest in time.
Editing Commonsense Knowledge in GPT
Gupta, A.; Mondal, D.; Sheshadri, A. K.; Zhao, W.; Li, X. L.; Wiegreffe, S.; and Tandon, N. 2023 · 2023
Closest in time.
Survey of Hallucination in Natural Language Generation
Ji, Z.; Lee, N.; Frieske, R.; Yu, T.; Su, D.; Xu, Y.; Ishii, E.; Bang, Y. J.; Madotto, A.; and Fung, P. 2023 · 2023
Closest in time.
Can LMs Learn New Entities from Descriptions? Challenges in Propagating Injected Knowledge
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
AlKhamissi, B.; Li, M.; Celikyilmaz, A.; Diab, M.; and Ghazvininejad, M. 2022 · 2022
Cited alongside, same era.
Knowledge Neurons in Pretrained Transformers
Dai, D.; Dong, L.; Hao, Y.; Sui, Z.; Chang, B.; and Wei, F. 2022 · 2022
Cited alongside, same era.
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection
Hartvigsen, T.; Gabriel, S.; Palangi, H.; Sap, M.; Ray, D.; and Kamar, E. 2022 · 2022
Cited alongside, same era.
Memory-Based Model Editing at Scale
Mitchell, E.; Lin, C.; Bosselut, A.; Manning, C. D.; and Finn, C. 2022b · 2022
Cited alongside, same era.
Locating and Editing Factual Knowledge in GPT
Meng, K.; Bau, D.; Andonian, A.; and Belinkov, Y. 2022a
Cited in the paper.
Mass-Editing Memory in a Transformer
Meng, K.; Sharma, A. S.; Andonian, A.; Belinkov, Y.; and Bau, D. 2022b
Cited in the paper.
Fast Model Editing at Scale
Mitchell, E.; Lin, C.; Bosselut, A.; Finn, C.; and Manning, C. D. 2022a
Cited in the paper.
Onoe, Y.; Zhang, M. J. Q.; Padmanabhan, S.; Durrett, G.; and Choi, E. 2023 · 2023
Closest in time.
OpenAI. 2023 · 2023
Closest in time.
LLaMA: Open and Efficient Foundation Language Models
Touvron, H.; Lavril, T.; Izacard, G.; Martinet, X.; Lachaux, M.-A.; Lacroix, T.; Rozière, B.; Goyal, N.; Hambro, E.; Azhar, F.; Rodriguez, A.; Joulin, A.; Grave, E.; and Lample, G. 2023 · 2023
Closest in time.
Can We Edit Factual Knowledge by In-Context Learning?
Zheng, C.; Li, L.; Dong, Q.; Fan, Y.; Wu, Z.; Xu, J.; and Chang, B. 2023 · 2023
Closest in time.
MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
Zhong, Z.; Wu, Z.; Manning, C. D.; Potts, C.; and Chen, D. 2023 · 2023
Closest in time.