Fetching the paper…

Reading the bibliography…

2019

Cross-Lingual Relevance Transfer for Document Retrieval

Shi, Peng, Lin, Jimmy

Original
PDF
Post on X

Understand

Recent work has shown the surprising ability of multi-lingual BERT to serve as a zero-shot cross-lingual transfer model for a number of language processing tasks.

We combine this finding with a similarly-recently proposal on sentence-level relevance modeling for document retrieval to demonstrate the ability of multi-lingual BERT to transfer models of relevance across languages.
Experiments on test collections in five different languages from diverse language families (Chinese, Arabic, French, Hindi, and Bengali) show that models trained with English data improve ranking quality, without any special processing, both for (non-English) mono-lingual retrieval as well as cross-lingual retrieval.

Cross-Lingual Relevance Transfer for Document Retrieval · Around

Built on

Passage re-ranking with BERT
Original
Rodrigo Nogueira and Kyunghyun Cho. 2019 · 1901
Earlier work this paper cites.
Simple applications of BERT for ad hoc document retrieval
Original
Wei Yang, Haotian Zhang, and Jimmy Lin. 2019b · 1903
Earlier work this paper cites.
Overview of the TREC-2014 Microblog Track
Jimmy Lin, Miles Efron, Yulu Wang, and Garrick Sherman. 2014 · 2014
Earlier work this paper cites.
Exploiting representations from statistical machine translation for cross-language information retrieval
Ferhan Ture and Jimmy Lin. 2014 · 2014
Earlier work this paper cites.

Similar

Anserini: reproducible ranking baselines using Lucene
Peilin Yang, Hui Fang, and Jimmy Lin. 2018 · 2018
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
CEDR: Contextualized embeddings for document ranking
Sean MacAvaney, Andrew Yates, Arman Cohan, and Nazli Goharian. 2019 · 2019
Cited alongside, same era.

Then

Beto, bentz, becas: The surprising cross-lingual effectiveness of BERT
Shijie Wu and Mark Dredze. 2019 · 2019
Closest in time.
End-to-end open-domain question answering with BERTserini
Wei Yang, Yuqing Xie, Aileen Lin, Xingyu Li, Luchen Tan, Kun Xiong, Ming Li, and Jimmy Lin. 2019a · 2019
Closest in time.
Cross-domain modeling of sentence-level evidence for document retrieval
Original
Zeynep Akkalyoncu Yilmaz, Wei Yang, Haotian Zhang, and Jimmy Lin. 2019 · 2019
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…