Contrastive Loss is All You Need to Recover Analogies as Parallel Lines

A synopsis of linguistic theory 1930-1955

J. Firth. 1957 · 1968

Earlier work this paper cites.

Placing search in context: the concept revisited

Lev Finkelstein, Evgeniy Gabrilovich, Y. Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, and Eytan Ruppin. 2002 · 2002

Earlier work this paper cites.

Learning a similarity metric discriminatively, with application to face verification

S. Chopra, R. Hadsell, and Y. LeCun. 2005 · 2005

Earlier work this paper cites.

Distance metric learning for large margin nearest neighbor classification

Kilian Q Weinberger, John Blitzer, and Lawrence Saul. 2005 · 2005

Earlier work this paper cites.

Linguistic regularities in continuous space word representations

Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig. 2013b · 2013

Earlier work this paper cites.

Multimodal distributional semantics

Elia Bruni, Nam Khanh Tran, and Marco Baroni. 2014 · 2014

Earlier work this paper cites.

Neural word embedding as implicit matrix factorization

Omer Levy and Yoav Goldberg. 2014 · 2014

Earlier work this paper cites.

GloVe: Global vectors for word representation

Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014 · 2014

Cited alongside, same era.

SimLex-999: Evaluating semantic models with (genuine) similarity estimation

Felix Hill, Roi Reichart, and Anna Korhonen. 2015 · 2015

Cited alongside, same era.

A latent variable model approach to PMI-based word embeddings

Sanjeev Arora, Yuanzhi Li, Yingyu Liang, Tengyu Ma, and Andrej Risteski. 2016 · 2016

Cited alongside, same era.

Analogy-based detection of morphological and semantic relations with word embeddings: what works and what doesn’t

Anna Gladkova, Aleksandr Drozd, and Satoshi Matsuoka. 2016 · 2016

Cited alongside, same era.

Issues in evaluating semantic spaces using word analogies

Tal Linzen. 2016 · 2016

Cited alongside, same era.

Skip-gram - Zipf + uniform = vector additivity

Alex Gittens, Dimitris Achlioptas, and Michael W. Mahoney. 2017 · 2017

Analogies explained: Towards understanding word embeddings

Carl Allen and Timothy Hospedales. 2019 · 2019

Later among the works it cites.

A latent variable model approach to pmi-based word embeddings

Original

Sanjeev Arora, Yuanzhi Li, Yingyu Liang, Tengyu Ma, and Andrej Risteski. 2019 · 2019

Later among the works it cites.

Towards understanding linear word analogies

Kawin Ethayarajh, David Duvenaud, and Graeme Hirst. 2019 · 2019

Later among the works it cites.

Analogies minus analogy test: measuring regularities in word embeddings

Louis Fournier, Emmanuel Dupoux, and Ewan Dunbar. 2020 · 2020

Later among the works it cites.

Paraphrases do not explain word analogies

Louis Fournier and Ewan Dunbar. 2021 · 2021

Later among the works it cites.

Wikimedia downloads

Wikimedia Foundation. 2023 · 2023