PASH at TREC 2021 Deep Learning Track: Generative Enhanced Model for Multi-stage Ranking

Document expansion by query prediction

Original

Nogueira, R., Yang, W., Lin, J. & Cho, K · 2019

Earlier work this paper cites.

Bm25 pseudo relevance feedback using anserini at waseda university

Zeng, Z. & Sakai, T · 2019

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K · 2019

Earlier work this paper cites.

Albert: A lite bert for self-supervised learning of language representations

Lan, Z. et al · 2019

Earlier work this paper cites.

Xlnet: Generalized autoregressive pretraining for language understanding

Yang, Z. et al · 2019

Cited alongside, same era.

Colbert: Efficient and effective passage search via contextualized late interaction over bert

Khattab, O. & Zaharia, M · 2020

Cited alongside, same era.

Electra: Pre-training text encoders as discriminators rather than generators

Original

Clark, K., Luong, M.-T., Le, Q. V. & Manning, C. D · 2020

Cited alongside, same era.

Exploring the limits of transfer learning with a unified text-to-text transformer

Raffel, C. et al · 2020

Later among the works it cites.

Efficient large-scale language model training on gpu clusters using megatron-lm

Narayanan, D. et al · 2021

Later among the works it cites.

The expando-mono-duo design pattern for text ranking with pretrained sequence-to-sequence models

Original

Pradeep, R., Nogueira, R. & Lin, J · 2021

Later among the works it cites.