MINERS: Multilingual Language Models as Semantic Retrievers

Improving multilingual sentence embedding using bi-directional dual encoder with additive margin softmax

Original

Yinfei Yang, Gustavo Hernandez Abrego, Steve Yuan, Mandy Guo, Qinlan Shen, Daniel Cer, Yun-Hsuan Sung, Brian Strope, and Ray Kurzweil. 2019b · 1902

Earlier work this paper cites.

Simple applications of bert for ad hoc document retrieval

Original

Wei Yang, Haotian Zhang, and Jimmy Lin. 2019a · 1903

Earlier work this paper cites.

Visualizing data using t-sne

Laurens Van der Maaten and Geoffrey Hinton. 2008 · 2008

Earlier work this paper cites.

Semeval-2017 task 1: Semantic textual similarity multilingual and crosslingual focused evaluation

Daniel Cer, Mona Diab, Eneko Agirre, Iñigo Lopez-Gazpio, and Lucia Specia. 2017 · 2017

Earlier work this paper cites.

Overview of the second bucc shared task: Spotting parallel sentences in comparable corpora

Pierre Zweigenbaum, Serge Sharoff, and Reinhard Rapp. 2017 · 2017

Earlier work this paper cites.

Universal sentence encoder for english

Daniel Cer, Yinfei Yang, Sheng-yi Kong, Nan Hua, Nicole Limtiaco, Rhomni St John, Noah Constant, Mario Guajardo-Cespedes, Steve Yuan, Chris Tar, et al. 2018 · 2018

Earlier work this paper cites.

Effective parallel corpus mining using bilingual sentence embeddings

Mandy Guo, Qinlan Shen, Yinfei Yang, Heming Ge, Daniel Cer, Gustavo Hernandez Abrego, Keith Stevens, Noah Constant, Yun-Hsuan Sung, Brian Strope, et al. 2018 · 2018

Earlier work this paper cites.

Overview of the third bucc shared task: Spotting parallel sentences in comparable corpora

Pierre Zweigenbaum, Serge Sharoff, and Reinhard Rapp. 2018 · 2018

Earlier work this paper cites.

Cross-lingual language model pretraining

Alexis Conneau and Guillaume Lample. 2019 · 2019

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

Sentence-bert: Sentence embeddings using siamese bert-networks

Nils Reimers and Iryna Gurevych. 2019 · 2019

Earlier work this paper cites.

Lince: A centralized benchmark for linguistic code-switching evaluation

Gustavo Aguilar, Sudipta Kar, and Thamar Solorio. 2020 · 2020

Earlier work this paper cites.

A sentiment analysis dataset for code-mixed malayalam-english

Bharathi Raja Chakravarthi, Navya Jose, Shardul Suryawanshi, Elizabeth Sherly, and John Philip McCrae. 2020 · 2020

Earlier work this paper cites.

Gluecos: An evaluation benchmark for code-switched nlp

Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, and Monojit Choudhury. 2020 · 2020

Earlier work this paper cites.

Colbert: Efficient and effective passage search via contextualized late interaction over bert

Omar Khattab and Matei Zaharia. 2020 · 2020

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive nlp tasks

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020 · 2020

Earlier work this paper cites.

Semeval-2020 task 9: Overview of sentiment analysis of code-mixed tweets

Parth Patwa, Gustavo Aguilar, Sudipta Kar, Suraj Pandey, Srinivas Pykl, Björn Gambäck, Tanmoy Chakraborty, Thamar Solorio, and Amitava Das. 2020 · 2020

Earlier work this paper cites.

Mpnet: Masked and permuted pre-training for language understanding

Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, and Tie-Yan Liu. 2020 · 2020

Earlier work this paper cites.

Phinc: A parallel hinglish social media code-mixed corpus for machine translation

Vivek Srivastava and Mayank Singh. 2020 · 2020

Earlier work this paper cites.

The tatoeba translation challenge–realistic data sets for low resource and multilingual mt

Jörg Tiedemann. 2020 · 2020

Cited alongside, same era.

Minilm: Deep self-attention distillation for task-agnostic compression of pre-trained transformers

Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, and Ming Zhou. 2020 · 2020

Cited alongside, same era.

Mad-g: Multilingual adapter generation for efficient cross-lingual transfer

Alan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, Sebastian Ruder, Goran Glavaš, Ivan Vulić, and Anna Korhonen. 2021 · 2021

Cited alongside, same era.

Nearest neighbour few-shot learning for cross-lingual classification

M Saiful Bari, Batool Haider, and Saab Mansour. 2021 · 2021

Cited alongside, same era.

Simcse: Simple contrastive learning of sentence embeddings

Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021 · 2021

Cited alongside, same era.

Massive: A 1m-example multilingual natural language understanding dataset with 51 typologically-diverse languages

Jack FitzGerald, Christopher Hench, Charith Peris, Scott Mackie, Kay Rottmann, Ana Sanchez, Aaron Nash, Liam Urbach, Vishesh Kakarala, Richa Singh, et al. 2023 · 2023

Later among the works it cites.

Glot500: Scaling multilingual corpora and language models to 500 languages

Ayyoob ImaniGooghari, Peiqin Lin, Amir Hossein Kargaran, Silvia Severini, Masoud Jalili Sabet, Nora Kassner, Chunlan Ma, Helmut Schmid, André FT Martins, François Yvon, et al. 2023 · 2023

Later among the works it cites.

Bloom: A 176b-parameter open-access multilingual language model

Original

Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilić, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, et al. 2023 · 2023

Later among the works it cites.

Unified demonstration retriever for in-context learning

Xiaonan Li, Kai Lv, Hang Yan, Tianyang Lin, Wei Zhu, Yuan Ni, Guotong Xie, Xiaoling Wang, and Xipeng Qiu. 2023 · 2023

Later among the works it cites.