2019

Measuring Domain Portability and ErrorPropagation in Biomedical QA

Hosein, Stefan, Andor, Daniel, McDonald, Ryan

Understand

In this work we present Google's submission to the BioASQ 7 biomedical question answering (QA) task (specifically Task 7b, Phase B).

The core of our systems are based on BERT QA models, specifically the model of \cite{alberti2019bert}.
In this report, and via our submissions, we aimed to investigate two research questions.
We start by studying how domain portable are QA systems that have been pre-trained and fine-tuned on general texts, e.g., Wikipedia.

Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Computation 9
1997
Earlier work this paper cites.
Yang, Z., Garduño, E., Fang, Y., Maiberg, A., McCormack, C., Nyberg, E.: Building optimal information systems automatically: configuration space exploration for biomedical information systems. In: CIKM (2013)
2013
Earlier work this paper cites.
Papanikolaou, Y., Dimitriadis, D., Tsoumakas, G., Laliotis, M., Markantonatos, N., Vlahavas, I.P.: Ensemble approaches for large-scale multi-label classification and question answering in biomedicine. In: CLEF (2014)
2014
Earlier work this paper cites.
Tsatsaronis, G., Balikas, G., Malakasiotis, P., Partalas, I., Zschunke, M., Alvers, M.R., Weissenborn, D., Krithara, A., Petridis, S., Polychronopoulos, D., Almirantis, Y., Pavlopoulos, J., Baskiotis, N., Gallinari, P., Artières, T., Ngomo, A.C.N., Heino, N., Gaussier, É., Barrio-Alvers, L., Schroeder, M., Androutsopoulos, I., Paliouras, G.: An overview of the bioasq large-scale biomedical semantic indexing and question answering competition. In: BMC Bioinformatics (2015)
2015
Earlier work this paper cites.
Tsatsaronis, G., Balikas, G., Malakasiotis, P., Partalas, I., Zschunke, M., Alvers, M.R., Weissenborn, D., Krithara, A., Petridis, S., Polychronopoulos, D., et al.: An overview of the bioasq large-scale biomedical semantic indexing and question answering competition. BMC bioinformatics 16
2015
Earlier work this paper cites.

Yang, Z., Gupta, N., Sun, X., Xu, D., Zhang, C., Nyberg, E.: Learning to answer biomedical factoid & list questions: Oaqa at bioasq 3b. In: CLEF (2015)
2015
Cited alongside, same era.
Rajpurkar, P., Zhang, J., Lopyrev, K., Liang, P.S.: Squad: 100, 000+ questions for machine comprehension of text. In: EMNLP (2016)
2016
Cited alongside, same era.
Weissenborn, D., Wiese, G., Seiffe, L.: Fastqa: A simple and efficient neural architecture for question answering. CoRR abs/1703.04816
Original
2017
Cited alongside, same era.
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Original
2018
Cited alongside, same era.
Nentidis, A., Krithara, A., Bougiatiotis, K., Paliouras, G., Kakadiaris, I.: Results of the sixth edition of the BioASQ challenge. In: Association for Computational Linguistics. pp. 1–10 (2018)
2018
Cited alongside, same era.

Reddy, S., Chen, D., Manning, C.D.: Coqa: A conversational question answering challenge. Transactions of the Association for Computational Linguistics 7
2018
Later among the works it cites.
Alberti, C., Lee, K., Collins, M.: A bert baseline for the natural questions. arXiv preprint arXiv:1901.08634 (2019)
Original
2019
Closest in time.
Kwiatkowski, T., Palomaki, J., Rhinehart, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Kelcey, M., Devlin, J., et al.: Natural questions: a benchmark for question answering research. Transactions of the Association of Computational Linguistics (2019)
2019
Closest in time.
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C.H., Kang, J.: Biobert: pre-trained biomedical language representation model for biomedical text mining. arXiv preprint arXiv:1901.08746 (2019)
Original
2019
Closest in time.
Pappas, D., McDonald, R., Androutsopoulos, I.: Aueb at bioasq 7:document and snippet retrieval. In: In Submission (2019)
2019
Closest in time.

alphaXiv searches the wider corpus for related work and actual follow-ups.

alphaXiv is searching for related work…

Reading the bibliography…