Fetching the paper…
Reading the bibliography…
We introduce CHEW, a novel dataset of changing events in Wikipedia expressed in naturally occurring text.
Analysing lexical semantic change with contextualised word representations
Mario Giulianelli, Marco Del Tredici, and Raquel Fernández. 2020 · 2004
Earlier work this paper cites.
Don’t stop pretraining: Adapt language models to domains and tasks
Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A Smith. 2020 · 2004
Earlier work this paper cites.
Modifying memories in transformer models
Chen Zhu, Ankit Singh Rawat, Manzil Zaheer, Srinadh Bhojanapalli, Daliang Li, Felix Yu, and Sanjiv Kumar. 2020 · 2012
Earlier work this paper cites.
What do wikidata and wikipedia have in common? an analysis of their use of external references
Alessandro Piscopo, Pavlos Vougiouklis, Lucie-Aimée Kaffee, Christopher Phethean, Jonathon Hare, and Elena Simperl. 2017 · 2017
Earlier work this paper cites.
Short-term meaning shift: A distributional exploration
Marco Del Tredici, Raquel Fernández, and Gemma Boleda. 2018 · 2018
Earlier work this paper cites.
Sentence-bert: Sentence embeddings using siamese bert-networks
Nils Reimers and Iryna Gurevych. 2019 · 2019
Earlier work this paper cites.
Understanding neural machine translation by simplification: The case of encoder-free models
Gongbo Tang, Rico Sennrich, and Joakim Nivre. 2019 · 2019
Earlier work this paper cites.
Semeval-2020 task 1: Unsupervised lexical semantic change detection
Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky, and Nina Tahmasebi. 2020 · 2020
Earlier work this paper cites.
Temporal effects on pre-trained models for language processing tasks
Oshin Agarwal and Ani Nenkova. 2021 · 2021
Earlier work this paper cites.
Knowledge neurons in pretrained transformers
Damai Dai, Li Dong, Yaru Hao, Zhifang Sui, Baobao Chang, and Furu Wei. 2021 · 2021
Earlier work this paper cites.
Editing factual knowledge in language models
Nicola De Cao, Wilker Aziz, and Ivan Titov. 2021 · 2021
Cited alongside, same era.
Lora: Low-rank adaptation of large language models
Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, and Weizhu Chen. 2021 · 2021
Cited alongside, same era.
Mind the gap: Assessing temporal generalization in neural language models
Angeliki Lazaridou, Adhi Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d’Autume, Tomas Kocisky, Sebastian Ruder, et al. 2021 · 2021
Cited alongside, same era.
Time waits for no one! analysis and challenges of temporal misalignment
Kelvin Luu, Daniel Khashabi, Suchin Gururangan, Karishma Mandyam, and Noah A Smith. 2021 · 2021
Cited alongside, same era.
Dict-bert: Enhancing language model pre-training with dictionary
Temporal attention for language models
Guy D Rosin and Kira Radinsky. 2022 · 2022
Later among the works it cites.
Interpretable word sense representations via definition generation: The case of semantic change analysis
Mario Giulianelli, Iris Luden, Raquel Fernandez, and Andrey Kutuzov. 2023 · 2023
Later among the works it cites.
Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al. 2023 · 2023
Later among the works it cites.
Llm2vec: Large language models are secretly powerful text encoders
Parishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, Dzmitry Bahdanau, Nicolas Chapados, and Siva Reddy. 2024 · 2024
Closest in time.
Dated data: Tracing knowledge cutoffs in large language models
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, and Meng Jiang. 2021 · 2021
Cited alongside, same era.
Time-aware language models as temporal knowledge bases
Bhuwan Dhingra, Jeremy R Cole, Julian Martin Eisenschlos, Daniel Gillick, Jacob Eisenstein, and William W Cohen. 2022 · 2022
Cited alongside, same era.
Temporalwiki: A lifelong benchmark for training and evaluating ever-evolving language models
Joel Jang, Seonghyeon Ye, Changho Lee, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, and Minjoon Seo. 2022 · 2022
Cited alongside, same era.
Streamingqa: A benchmark for adaptation to new knowledge over time in question answering models
Adam Liska, Tomas Kocisky, Elena Gribovskaya, Tayfun Terzi, Eren Sezener, Devang Agrawal, D’Autume Cyprien De Masson, Tim Scholtes, Manzil Zaheer, Susannah Young, et al. 2022 · 2022
Cited alongside, same era.
Mllabs-lig at tempowic 2022: A generative approach for examining temporal meaning shift
Chenyang Lyu, Yongxin Zhou, and Tianbo Ji. 2022 · 2022
Cited alongside, same era.
Training language models to follow instructions with human feedback
Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022 · 2022
Cited alongside, same era.
Timelms: Diachronic language models from twitter
Daniel Loureiro, Francesco Barbieri, Leonardo Neves, Luis Espinosa Anke, and Jose Camacho-Collados. 2022a
Cited in the paper.
Tempowic: An evaluation benchmark for detecting meaning shift in social media
Daniel Loureiro, Aminette D’Souza, Areej Nasser Muhajab, Isabella A White, Gabriel Wong, Luis Espinosa Anke, Leonardo Neves, Francesco Barbieri, and Jose Camacho-Collados. 2022b
Cited in the paper.
Jeffrey Cheng, Marc Marone, Orion Weller, Dawn Lawrie, Daniel Khashabi, and Benjamin Van Durme. 2024 · 2024
Closest in time.
Realtime qa: What’s the answer right now?
Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Akari Asai, Xinyan Yu, Dragomir Radev, Noah A Smith, Yejin Choi, Kentaro Inui, et al. 2024 · 2024
Closest in time.
Beyond perplexity: Examining temporal generalization in large language models via definition generation
Iris Luden, Mario Giulianelli, and Raquel Fernández. 2024 · 2024
Closest in time.
Temporal blind spots in large language models
Jonas Wallat, Adam Jatowt, and Avishek Anand. 2024 · 2024
Closest in time.
Set the clock: Temporal alignment of pretrained language models
Bowen Zhao, Zander Brumbaugh, Yizhong Wang, Hannaneh Hajishirzi, and Noah A Smith. 2024 · 2024
Closest in time.
Short-term meaning shift: A distributional exploration
Marco Del Tredici, Raquel Fernández, and Gemma Boleda. 2019 · 2075
Closest in time.