ColBERT Retrieval and Ensemble Response Scoring for Language Model Question Answering

S. Robertson, S. Walker, S. Jones, M. M. Hancock-Beaulieu, and M. Gatford, “Okapi at trec-3,” in Overview of the Third Text REtrieval Conference (TREC-3) , January 1995, pp. 109–126

1995

Earlier work this paper cites.

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, “Language Models are Few-Shot Learners,” Jul. 2020, arXiv:2005.14165 [cs]

Original

2005

Earlier work this paper cites.

I. Dagan, O. Glickman, and B. Magnini, “The PASCAL Recognising Textual Entailment Challenge,” in Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Tectual Entailment , 2006, pp. 177–190

2006

Earlier work this paper cites.

Y. Gu, R. Tinn, H. Cheng, M. Lucas, N. Usuyama, X. Liu, T. Naumann, J. Gao, and H. Poon, “Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing,” ACM Transactions on Computing for Healthcare , vol. 3, no. 1, pp. 1–23, Jan. 2022, arXiv:2007.15779 [cs]

Original

2007

Earlier work this paper cites.

D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, and J. Steinhardt, “Measuring Massive Multitask Language Understanding,” Jan. 2021, arXiv:2009.03300 [cs]

Original

2009

Earlier work this paper cites.

H. Shima, H. Kanayama, C.-W. Lee, C.-J. Lin, T. Mitamura, Y. Miyao, S. Shi, and K. Takeda, “Overview of NTCIR-9 RITE: Recognizing Inference in TExt,” in Proceedings of the 9th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, NTCIR-9, National Center of Sciences, Tokyo, Japan, December 6-9, 2011 , Dec. 2011

2011

Earlier work this paper cites.

A. Williams, N. Nangia, and S. Bowman, “A broad-coverage challenge corpus for sentence understanding through inference,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) , Jun. 2018, pp. 1112–1122

2018

Earlier work this paper cites.

E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “LoRA: Low-Rank Adaptation of Large Language Models,” Oct. 2021, arXiv:2106.09685 [cs]

Original

2021

Earlier work this paper cites.

J. Johnson, M. Douze, and H. Jegou, “Billion-scale similarity search with gpus,” IEEE Transactions on Big Data , vol. 7, no. 3, pp. 535–547, Jul. 2021

2021

Cited alongside, same era.

K. Santhanam, O. Khattab, J. Saad-Falcon, C. Potts, and M. Zaharia, “ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction,” Jul. 2022, arXiv:2112.01488 [cs]

Original

2022

Cited alongside, same era.

Y. Alharahseheh, R. Obeidat, M. Al-Ayoub, and M. Gharaibeh, “A Survey on Textual Entailment: Benchmarks, Approaches and Applications,” in 2022 13th International Conference on Information and Communication Systems (ICICS) , Jun. 2022, pp. 328–336, iSSN: 2573-3346

2022

Cited alongside, same era.

A. Pal, L. K. Umapathi, and M. Sankarasubbu, “MedMCQA: A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering,” in Proceedings of the Conference on Health, Inference, and Learning , Apr. 2022, pp. 248–260, iSSN: 2640-3498

2022

Cited alongside, same era.

E. Almazrouei, H. Alobeidli, A. Alshamsi, A. Cappelli, R. Cojocaru, M. Debbah, É. Goffinet, D. Hesslow, J. Launay, Q. Malartic et al. , “The falcon series of open language models,” arXiv preprint arXiv:2311.16867 , 2023

Original

2023

Later among the works it cites.

A. Maatouk, F. Ayed, N. Piovesan, A. De Domenico, M. Debbah, and Z.-Q. Luo, “TeleQnA: A Benchmark Dataset to Assess Large Language Models Telecommunications Knowledge,” Oct. 2023

2023

Later among the works it cites.

Z. Li, X. Zhang, Y. Zhang, D. Long, P. Xie, and M. Zhang, “Towards General Text Embeddings with Multi-stage Contrastive Learning,” Aug. 2023, arXiv:2308.03281 [cs]

Original

2023

Later among the works it cites.

OpenAI, “GPT-4 Technical Report,” Mar. 2024, arXiv:2303.08774 [cs]

Original

2024

Closest in time.

T. Ahmed, N. Piovesan, A. De Domenico, and S. Choudhury, “Linguistic intelligence in large language models for telecommunications,” Feb. 2024, arXiv:2402.15818 [cs]