Fetching the paper…
Reading the bibliography…
Modern language models are capable of contextualizing words based on their surrounding context.
A Semantic Concordance
George A. Miller, Claudia Leacock, Randee Tengi, and Ross T. Bunker. 1993 · 1993
Earlier work this paper cites.
WordNet: An Electronic Lexical Database
Christiane Fellbaum. 1998 · 1998
Earlier work this paper cites.
Aspects of the micro-structure of word meanings
D. Alan Cruse. 2000 · 2000
Earlier work this paper cites.
Attention is All you Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Visualizing and Measuring the Geometry of BERT
Andy Coenen, Emily Reif, Ann Yuan, Been Kim, Adam Pearce, Fernanda Viégas, and Martin Wattenberg. 2019 · 2019
Earlier work this paper cites.
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings
Kawin Ethayarajh. 2019 · 2019
Earlier work this paper cites.
What Does BERT Learn about the Structure of Language?
Ganesh Jawahar, Benoît Sagot, and Djamé Seddah. 2019 · 2019
Earlier work this paper cites.
Is Attention Interpretable?
Sofia Serrano and Noah A. Smith. 2019 · 2019
Earlier work this paper cites.
BOS at SemEval-2020 Task 1: Word Sense Induction via Lexical Substitution for Lexical Semantic Change Detection
Nikolay Arefyev and Vasily Zhikov. 2020 · 2020
Earlier work this paper cites.
DIACR-Ita@ EVALITA2020: Overview of the EVALITA2020 DiachronicLexical Semantics (DIACR-Ita) Task
Pierpaolo Basile, Annalina Caputo, Tommaso Caselli, Pierluigi Cassotti, and Rossella Varvara. 2020 · 2020
Earlier work this paper cites.
How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT’s Attention
Yue Guan, Jingwen Leng, Chao Li, Quan Chen, and Minyi Guo. 2020 · 2020
Earlier work this paper cites.
UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detection
Andrey Kutuzov and Mario Giulianelli. 2020 · 2020
Earlier work this paper cites.
SenseBERT: Driving Some Sense into BERT
Yoav Levine, Barak Lenz, Or Dagan, Ori Ram, Dan Padnos, Or Sharir, Shai Shalev-Shwartz, Amnon Shashua, and Yoav Shoham. 2020 · 2020
Earlier work this paper cites.
What do you mean, BERT?
Timothee Mickus, Denis Paperno, Mathieu Constant, and Kees van Deemter. 2020 · 2020
Earlier work this paper cites.
Don’t Invite BERT to Drink a Bottle: Modeling the Interpretation of Metonymies Using BERT and Distributional Representations
Paolo Pedinotti and Alessandro Lenci. 2020 · 2020
Earlier work this paper cites.
Temporally-informed analysis of named entity recognition
Shruti Rijhwani and Daniel Preotiuc-Pietro. 2020 · 2020
Earlier work this paper cites.
SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection
Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky, and Nina Tahmasebi. 2020 · 2020
Earlier work this paper cites.
Detecting Different Forms of Semantic Shift in Word Embeddings via Paradigmatic and Syntagmatic Association Changes
Anna Wegmann, Florian Lemmerich, and Markus Strohmaier. 2020 · 2020
Cited alongside, same era.
How does BERT Capture Semantics? A Closer Look at Polysemous Words
David Yenicelik, Florian Schmidt, and Yannic Kilcher. 2020 · 2020
Cited alongside, same era.
Why Attentions May Not Be Interpretable?
Bing Bai, Jian Liang, Guanhua Zhang, Hao Li, Kun Bai, and Fei Wang. 2021 · 2021
Cited alongside, same era.
Isotropy in the Contextual Embedding Space: Clusters and Manifolds
Xingyu Cai, Jiaji Huang, Yuchen Bian, and Kenneth Church. 2021 · 2021
Cited alongside, same era.
Let’s Play Mono-Poly: BERT Can Reveal Words’ Polysemy Level and Partitionability into Senses
Aina Garí Soler and Marianna Apidianaki. 2021 · 2021
Cited alongside, same era.
Patterns of Polysemy and Homonymy in Contextualised Language Models
Contextualized embeddings for semantic change detection: Lessons learned
Andrey Kutuzov, Erik Velldal, and Lilja Øvrelid. 2022 · 2022
Later among the works it cites.
What is Done is Done: an Incremental Approach to Semantic Shift Detection
Francesco Periti, Alfio Ferrara, Stefano Montanelli, and Martin Ruskov. 2022 · 2022
Later among the works it cites.
Time Masking for Temporal Language Models
Guy D. Rosin, Ido Guy, and Kira Radinsky. 2022 · 2022
Later among the works it cites.
Temporal Attention for Language Models
Guy D. Rosin and Kira Radinsky. 2022 · 2022
Later among the works it cites.
Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change
Zhaochen Su, Zecheng Tang, Xinyan Guan, Lijun Wu, Min Zhang, and Juntao Li. 2022 · 2022
Later among the works it cites.
LSCDiscovery: A Shared Task on Semantic Change Discovery and Detection in Spanish
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Janosch Haber and Massimo Poesio. 2021 · 2021
Cited alongside, same era.
Analyzing BERT’s Knowledge of Hypernymy via Prompting
Michael Hanna and David Mareček. 2021 · 2021
Cited alongside, same era.
How effective is BERT without word ordering? Implications for language understanding and data privacy
Jack Hessel and Alexandra Schofield. 2021 · 2021
Cited alongside, same era.
Exploring Sentence Embedding Structures for Semantic Relation Extraction
Alexander Kalinowski and Yuan An. 2021 · 2021
Cited alongside, same era.
RuShiftEval: A Shared Task on Semantic Shift Detection for Russian
Andrey Kutuzov and Lidia Pivovarova. 2021 · 2021
Cited alongside, same era.
ALaSca: an Automated approach for Large-Scale Lexical Substitution
Caterina Lacerra, Tommaso Pasini, Rocco Tripodi, and Roberto Navigli. 2021 · 2021
Cited alongside, same era.
Explaining and Improving BERT Performance on Lexical Semantic Change Detection
Severin Laicher, Sinan Kurtyigit, Dominik Schlechtweg, Jonas Kuhn, and Sabine Schulte im Walde. 2021 · 2021
Cited alongside, same era.
Frank D. Zamora-Reina, Felipe Bravo-Marquez, and Dominik Schlechtweg. 2022 · 2022
Later among the works it cites.
Substitution-based semantic change detection using contextual embeddings
Dallas Card. 2023 · 2023
Later among the works it cites.
XL-LEXEME: WiC pretrained model for cross-lingual LEXical sEMantic changE
Pierluigi Cassotti, Lucia Siciliani, Marco DeGemmis, Giovanni Semeraro, and Pierpaolo Basile. 2023 · 2023
Later among the works it cites.
Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization
Chi Cheang, Hou Chan, Derek Wong, Xuebo Liu, Zhaocong Li, Yanming Sun, Shudong Liu, and Lidia Chao. 2023 · 2023
Later among the works it cites.
Qlora: Efficient finetuning of quantized llms
Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023 · 2023
Later among the works it cites.
Learn over Past, Evolve for Future: Forecasting Temporal Trends for Fake News Detection
Beizhe Hu, Qiang Sheng, Juan Cao, Yongchun Zhu, Danding Wang, Zhengjia Wang, and Zhiwei Jin. 2023 · 2023
Later among the works it cites.
A Survey on Contextualised Semantic Shift Detection
Stefano Montanelli and Francesco Periti. 2023 · 2023
Later among the works it cites.
Computational modeling of semantic change
Nina Tahmasebi and Haim Dubossarsky. 2023 · 2023
Later among the works it cites.
Llama 2: Open foundation and fine-tuned chat models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. 2023 · 2023
Later among the works it cites.
Survey in Characterization of Semantic Change
Jader Martins Camboim de Sá, Marcos Da Silveira, and Cédric Pruski. 2024 · 2024
Closest in time.
(Chat)GPT v BERT Dawn of Justice for Semantic Change Detection
Francesco Periti, Haim Dubossarsky, and Nina Tahmasebi. 2024 · 2024
Closest in time.
A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Change
Francesco Periti and Nina Tahmasebi. 2024 · 2024
Closest in time.