Fetching the paper…
Reading the bibliography…
Transformer-based pretrained language models (PLMs) have started a new era in modern natural language processing (NLP).
G. Pergola, E. Kochkina, L. Gui, M. Liakata, and Y. He, “Boosting low-resource biomedical qa via entity-aware masking strategies,” in Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume , 2021, pp. 1977–1985
1985
Earlier work this paper cites.
O. Bodenreider, “The unified medical language system (umls): integrating biomedical terminology,” Nucleic acids research , vol. 32, no. suppl_1, pp. D267–D270, 2004
2004
Earlier work this paper cites.
N. Collier and J.-D. Kim, “Introduction to the bio-entity recognition task at jnlpba,” in Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and its Applications (NLPBA/BioNLP) , 2004, pp. 73–78
2004
Earlier work this paper cites.
R. Bunescu, R. Ge, R. J. Kate, E. M. Marcotte, R. J. Mooney, A. K. Ramani, and Y. W. Wong, “Comparative experiments on learning information extractors for proteins and their interactions,” Artificial intelligence in medicine , vol. 33, no. 2, pp. 139–155, 2005
2005
Earlier work this paper cites.
S. J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Transactions on knowledge and data engineering , vol. 22, no. 10, pp. 1345–1359, 2009
2009
Earlier work this paper cites.
D. Demner-Fushman, W. W. Chapman, and C. J. McDonald, “What can natural language processing do for clinical decision support?” Journal of biomedical informatics , vol. 42, no. 5, pp. 760–772, 2009
2009
Earlier work this paper cites.
T. Botsis, G. Hartvigsen, F. Chen, and C. Weng, “Secondary use of ehr: data quality issues and informatics opportunities,” Summit on Translational Bioinformatics , vol. 2010, p. 1, 2010
2010
Earlier work this paper cites.
M. Saeed, M. Villarroel, A. T. Reisner, G. Clifford, L.-W. Lehman, G. Moody, T. Heldt, T. H. Kyaw, B. Moody, and R. G. Mark, “Multiparameter intelligent monitoring in intensive care ii (mimic-ii): a public-access intensive care unit database,” Critical care medicine , vol. 39, no. 5, p. 952, 2011
2011
Earlier work this paper cites.
Ö. Uzuner, B. R. South, S. Shen, and S. L. DuVall, “2010 i2b2/va challenge on concepts, assertions, and relations in clinical text,” Journal of the American Medical Informatics Association , vol. 18, no. 5, pp. 552–556, 2011
2011
Earlier work this paper cites.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” Advances in neural information processing systems , vol. 25, pp. 1097–1105, 2012
2012
Earlier work this paper cites.
P. B. Jensen, L. J. Jensen, and S. Brunak, “Mining electronic health records: towards better research applications and clinical care,” Nature Reviews Genetics , vol. 13, no. 6, pp. 395–405, 2012
2012
Earlier work this paper cites.
E. M. Van Mulligen, A. Fourrier-Reglat, D. Gurwitz, M. Molokhia, A. Nieto, G. Trifiro, J. A. Kors, and L. I. Furlong, “The eu-adr corpus: annotated drugs, diseases, targets, and their relationships,” Journal of biomedical informatics , vol. 45, no. 5, pp. 879–884, 2012
2012
Earlier work this paper cites.
2013
Earlier work this paper cites.
D. Charles, M. Gabriel, and M. F. Furukawa, “Adoption of electronic health record systems among us non-federal acute care hospitals: 2008-2014,” ONC data brief , vol. 9, pp. 1–9, 2013
2013
Earlier work this paper cites.
A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko, “Translating embeddings for modeling multi-relational data,” Advances in neural information processing systems , vol. 26, 2013
2013
Earlier work this paper cites.
W. Sun, A. Rumshisky, and O. Uzuner, “Evaluating temporal relations in clinical text: 2012 i2b2 challenge,” Journal of the American Medical Informatics Association , vol. 20, no. 5, pp. 806–813, 2013
2013
Earlier work this paper cites.
M. Herrero-Zazo, I. Segura-Bedmar, P. Martínez, and T. Declerck, “The ddi corpus: An annotated corpus with pharmacological substances and drug–drug interactions,” Journal of biomedical informatics , vol. 46, no. 5, pp. 914–920, 2013
2013
Earlier work this paper cites.
P. Blunsom, E. Grefenstette, and N. Kalchbrenner, “A convolutional neural network for modelling sentences,” in Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics . Proceedings of the 52nd Annual Meeting of the Association for Computational …, 2014
2014
Earlier work this paper cites.
J. Pennington, R. Socher, and C. D. Manning, “Glove: Global vectors for word representation,” in Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) , 2014, pp. 1532–1543
2014
Earlier work this paper cites.
K. O’Connor, P. Pimpalkhute, A. Nikfarjam, R. Ginn, K. L. Smith, and G. Gonzalez, “Pharmacovigilance on twitter? mining tweets for adverse drug reactions,” in AMIA annual symposium proceedings , vol. 2014. American Medical Informatics Association, 2014, p. 924
2014
Earlier work this paper cites.
R. I. Doğan, R. Leaman, and Z. Lu, “Ncbi disease corpus: a resource for disease name recognition and concept normalization,” Journal of biomedical informatics , vol. 47, pp. 1–10, 2014
2014
Earlier work this paper cites.
R. Mishra, J. Bian, M. Fiszman, C. R. Weir, S. Jonnalagadda, J. Mostafa, and G. Del Fiol, “Text summarization in the biomedical domain: a systematic review of recent research,” Journal of biomedical informatics , vol. 52, pp. 457–467, 2014
2014
Earlier work this paper cites.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2015, pp. 1–9
2015
Earlier work this paper cites.
S. Bowman, G. Angeli, C. Potts, and C. D. Manning, “A large annotated corpus for learning natural language inference,” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing , 2015, pp. 632–642
2015
Earlier work this paper cites.
G. S. Birkhead, M. Klompas, and N. R. Shah, “Uses of electronic health records for public health surveillance to advance public health,” Annual review of public health , vol. 36, pp. 345–359, 2015
2015
Earlier work this paper cites.
N. Limsopatham and N. Collier, “Adapting phrase-based machine translation to normalise medical terms in social media messages,” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing , 2015, pp. 1675–1680
2015
Earlier work this paper cites.
S. Karimi, A. Metke-Jimenez, M. Kemp, and C. Wang, “Cadec: A corpus of adverse drug event annotations,” Journal of biomedical informatics , vol. 55, pp. 73–81, 2015
2015
Earlier work this paper cites.
M. Krallinger, O. Rabal, F. Leitner, M. Vazquez, D. Salgado, Z. Lu, R. Leaman, Y. Lu, D. Ji, D. M. Lowe et al. , “The chemdner corpus of chemicals and drugs and its annotation principles,” Journal of cheminformatics , vol. 7, no. 1, pp. 1–17, 2015
2015
Earlier work this paper cites.
P. Liu, X. Qiu, and X. Huang, “Recurrent neural network for text classification with multi-task learning,” in Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence , 2016, pp. 2873–2879
2016
Earlier work this paper cites.
Y. Kim, Y. Jernite, D. Sontag, and A. M. Rush, “Character-aware neural language models,” in Thirtieth AAAI conference on artificial intelligence , 2016
2016
Earlier work this paper cites.
2016
Earlier work this paper cites.
2016
Earlier work this paper cites.
R. Sennrich, B. Haddow, and A. Birch, “Neural machine translation of rare words with subword units,” in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2016, pp. 1715–1725
2016
Earlier work this paper cites.
A. E. Johnson, T. J. Pollard, L. Shen, H. L. Li-Wei, M. Feng, M. Ghassemi, B. Moody, P. Szolovits, L. A. Celi, and R. G. Mark, “Mimic-iii, a freely accessible critical care database,” Scientific data , vol. 3, no. 1, pp. 1–9, 2016
2016
Earlier work this paper cites.
S. Hassanpour and C. P. Langlotz, “Information extraction from multi-institutional radiology reports,” Artificial intelligence in medicine , vol. 66, pp. 29–39, 2016
2016
Earlier work this paper cites.
J. Li, Y. Sun, R. J. Johnson, D. Sciaky, C.-H. Wei, R. Leaman, A. P. Davis, C. J. Mattingly, T. C. Wiegers, and Z. Lu, “Biocreative v cdr task corpus: a resource for chemical disease relation extraction,” Database , vol. 2016, 2016
2016
Earlier work this paper cites.
Y. A. AL-Khassawneh, N. Salim, and A. I. Obasae, “Sentence similarity techniques for automatic text summarization,” Journal of Soft Computing and Decision Support Systems , vol. 3, no. 3, pp. 35–41, 2016
2016
Earlier work this paper cites.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” in Advances in neural information processing systems , 2017, pp. 5998–6008
2017
Earlier work this paper cites.
P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov, “Enriching word vectors with subword information,” Transactions of the Association for Computational Linguistics , vol. 5, pp. 135–146, 2017
2017
Earlier work this paper cites.
G. Soğancıoğlu, H. Öztürk, and A. Özgür, “Biosses: a semantic sentence similarity estimation system for the biomedical domain,” Bioinformatics , vol. 33, no. 14, pp. i49–i58, 2017
2017
Earlier work this paper cites.
M. Krallinger, O. Rabal, S. A. Akhondi, M. P. Pérez, J. Santamaría, G. P. Rodríguez, G. Tsatsaronis, and A. Intxaurrondo, “Overview of the biocreative vi chemical-protein interaction track,” in Proceedings of the sixth BioCreative challenge evaluation workshop , vol. 1, 2017, pp. 141–146
2017
Earlier work this paper cites.
Y. Wang, S. Liu, N. Afzal, M. Rastegar-Mojarad, L. Wang, F. Shen, P. Kingsbury, and H. Liu, “A comparison of word embeddings for the biomedical natural language processing,” Journal of biomedical informatics , vol. 87, pp. 12–20, 2018
2018
Earlier work this paper cites.
A. Williams, N. Nangia, and S. Bowman, “A broad-coverage challenge corpus for sentence understanding through inference,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) , 2018, pp. 1112–1122
2018
Earlier work this paper cites.
A. Romanov and C. Shivade, “Lessons from natural language inference in the clinical domain,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , 2018, pp. 1586–1596
2018
Earlier work this paper cites.
S. Mohan and D. Li, “Medmentions: A large biomedical corpus annotated with umls concepts,” in Automated Knowledge Base Construction (AKBC) , 2018
2018
Earlier work this paper cites.
M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer, “Deep contextualized word representations,” in Proceedings of NAACL-HLT , 2018, pp. 2227–2237
2018
Earlier work this paper cites.
T. Kudo, “Subword regularization: Improving neural network translation models with multiple subword candidates,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2018, pp. 66–75
2018
Earlier work this paper cites.
T. Kudo and J. Richardson, “Sentencepiece: A simple and language independent subword tokenizer and detokenizer for neural text processing,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations , 2018, pp. 66–71
2018
Earlier work this paper cites.
D. Hoogeveen, A. Bennett, Y. Li, K. M. Verspoor, and T. Baldwin, “Detecting misflagged duplicate questions in community question-answering archives,” in Twelfth international AAAI conference on web and social media , 2018
2018
Earlier work this paper cites.
A. Pampari, P. Raghavan, J. Liang, and J. Peng, “emrqa: A large corpus for question answering on electronic medical records,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , 2018, pp. 2357–2368
2018
Earlier work this paper cites.
S. Suster and W. Daelemans, “Clicr: a dataset of clinical case reports for machine reading comprehension,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) , 2018, pp. 1551–1563
2018
Earlier work this paper cites.
M. Moradi and N. Ghadiri, “Different approaches for identifying important concepts in probabilistic biomedical text summarization,” Artificial intelligence in medicine , vol. 84, pp. 101–116, 2018
2018
Earlier work this paper cites.
P. Gigioli, N. Sagar, A. Rao, and J. Voyles, “Domain-aware abstractive text summarization for medical documents,” in 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) . IEEE, 2018, pp. 2338–2343
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
A. Wang, A. Singh, J. Michael, F. Hill, O. Levy, and S. Bowman, “Glue: A multi-task benchmark and analysis platform for natural language understanding,” in Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP , 2018, pp. 353–355
2018
Earlier work this paper cites.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , 2019, pp. 4171–4186
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, and R. Soricut, “Albert: A lite bert for self-supervised learning of language representations,” in International Conference on Learning Representations , 2019
2019
Earlier work this paper cites.
E. Alsentzer, J. Murphy, W. Boag, W.-H. Weng, D. Jindi, T. Naumann, and M. McDermott, “Publicly available clinical bert embeddings,” in Proceedings of the 2nd Clinical Natural Language Processing Workshop , 2019, pp. 72–78
2019
Earlier work this paper cites.
Y. Peng, S. Yan, and Z. Lu, “Transfer learning in biomedical natural language processing: An evaluation of bert and elmo on ten benchmarking datasets,” in Proceedings of the 18th BioNLP Workshop and Shared Task , 2019, pp. 58–65
2019
Earlier work this paper cites.
F. K. Khattak, S. Jeblee, C. Pou-Prom, M. Abdalla, C. Meaney, and F. Rudzicz, “A survey of word embeddings for clinical text,” Journal of Biomedical Informatics: X , vol. 4, p. 100057, 2019
2019
Earlier work this paper cites.
Y. Si, J. Wang, H. Xu, and K. Roberts, “Enhancing clinical concept extraction with contextual embeddings,” Journal of the American Medical Informatics Association , vol. 26, no. 11, pp. 1297–1304, 2019
2019
Earlier work this paper cites.
K. Clark, M.-T. Luong, Q. V. Le, and C. D. Manning, “Electra: Pre-training text encoders as discriminators rather than generators,” in International Conference on Learning Representations , 2019
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
C. Cengiz, U. Sert, and D. Yuret, “Ku_ai at mediqa 2019: Domain-specific pre-training and transfer learning for medical nli,” in Proceedings of the 18th BioNLP Workshop and Shared Task , 2019, pp. 427–436
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
X. Liu, P. He, W. Chen, and J. Gao, “Multi-task deep neural networks for natural language understanding,” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , 2019, pp. 4487–4496
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
Z. Yang, Z. Dai, Y. Yang, J. Carbonell, R. R. Salakhutdinov, and Q. V. Le, “Xlnet: Generalized autoregressive pretraining for language understanding,” Advances in neural information processing systems , vol. 32, 2019
2019
Earlier work this paper cites.
I. Beltagy, K. Lo, and A. Cohan, “Scibert: A pretrained language model for scientific text,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , 2019, pp. 3615–3620
2019
Earlier work this paper cites.
I. Y. Chen, P. Szolovits, and M. Ghassemi, “Can ai help reduce disparities in general medical and mental health care?” AMA journal of ethics , vol. 21, no. 2, pp. 167–179, 2019
2019
Earlier work this paper cites.
K.-H. Yu and I. S. Kohane, “Framing the challenges of artificial intelligence in medicine,” BMJ quality & safety , vol. 28, no. 3, pp. 238–241, 2019
2019
Cited alongside, same era.
C. Sun, A. Myers, C. Vondrick, K. Murphy, and C. Schmid, “Videobert: A joint model for video and language representation learning,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2019, pp. 7464–7473
2019
Cited alongside, same era.
2019
Cited alongside, same era.
W. Su, X. Zhu, Y. Cao, B. Li, L. Lu, F. Wei, and J. Dai, “Vl-bert: Pre-training of generic visual-linguistic representations,” in International Conference on Learning Representations , 2019
2019
Cited alongside, same era.
J. Canete, G. Chaperon, R. Fuentes, and J. Pérez, “Spanish pre-trained bert model and evaluation data,” Pml4dc at iclr , vol. 2020, 2020
2020
Later among the works it cites.
A. Conneau, K. Khandelwal, N. Goyal, V. Chaudhary, G. Wenzek, F. Guzmán, É. Grave, M. Ott, L. Zettlemoyer, and V. Stoyanov, “Unsupervised cross-lingual representation learning at scale,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , 2020, pp. 8440–8451
2020
Later among the works it cites.
N. Poerner, U. Waltinger, and H. Schütze, “Inexpensive domain adaptation of pretrained language models: Case studies on biomedical ner and covid-19 qa,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings , 2020, pp. 1482–1490
2020
Later among the works it cites.
W. Tai, H. Kung, X. L. Dong, M. Comiter, and C.-F. Kuo, “exbert: Extending pre-trained models with domain-specific vocabulary under constrained training resources,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings , 2020, pp. 1433–1439
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
J. Lu, D. Batra, D. Parikh, and S. Lee, “Vilbert: pretraining task-agnostic visiolinguistic representations for vision-and-language tasks,” in Proceedings of the 33rd International Conference on Neural Information Processing Systems , 2019, pp. 13–23
2019
Cited alongside, same era.
H. Tan and M. Bansal, “Lxmert: Learning cross-modality encoder representations from transformers,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , 2019, pp. 5100–5111
2019
Cited alongside, same era.
N. Reimers and I. Gurevych, “Sentence-bert: Sentence embeddings using siamese bert-networks,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , 2019, pp. 3982–3992
2019
Cited alongside, same era.
K. raj Kanakarajan, S. Ramamoorthy, V. Archana, S. Chatterjee, and M. Sankarasubbu, “Saama research at mediqa 2019: Pre-trained biobert with attention visualisation for medical natural language inference,” in Proceedings of the 18th BioNLP Workshop and Shared Task , 2019, pp. 510–516
2019
Cited alongside, same era.
K. C. Fraser, I. Nejadgholi, B. De Bruijn, M. Li, A. LaPlante, and K. Z. El Abidine, “Extracting umls concepts from medical text using general and domain-specific deep learning models,” EMNLP-IJCNLP 2019 , p. 157, 2019
2019
Cited alongside, same era.
X. Yu, W. Hu, S. Lu, X. Sun, and Z. Yuan, “Biobert based named entity recognition in electronic medical record,” in 2019 10th International Conference on Information Technology in Medicine and Education (ITME) . IEEE, 2019, pp. 49–52
2019
Cited alongside, same era.
Q. Wei, Z. Ji, Y. Si, J. Du, J. Wang, F. Tiryaki, S. Wu, C. Tao, K. Roberts, and H. Xu, “Relation extraction from clinical narratives using pre-trained language models,” in AMIA Annual Symposium Proceedings , vol. 2019. American Medical Informatics Association, 2019, p. 1236
2019
Cited alongside, same era.
A. Thillaisundaram and T. Togia, “Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture,” in Proceedings of The 5th Workshop on BioNLP Open Shared Tasks , 2019, pp. 84–89
2019
Cited alongside, same era.
2020
Later among the works it cites.
H. Zhang, A. X. Lu, M. Abdalla, M. McDermott, and M. Ghassemi, “Hurtful words: quantifying biases in clinical contextual word embeddings,” in proceedings of the ACM Conference on Health, Inference, and Learning , 2020, pp. 110–120
2020
Later among the works it cites.
Y. Chen, M. Rouhsedaghat, S. You, R. Rao, and C.-C. J. Kuo, “Pixelhop++: A small successive-subspace-learning-based (ssl-based) model for image classification,” in 2020 IEEE International Conference on Image Processing (ICIP) . IEEE, 2020, pp. 3294–3298
2020
Later among the works it cites.
K. S. Kalyan and S. Sangeetha, “Target concept guided medical concept normalization in noisy user-generated texts,” in Proceedings of Deep Learning Inside Out (DeeLIO): The First Workshop on Knowledge Extraction and Integration for Deep Learning Architectures , 2020, pp. 64–73
2020
Later among the works it cites.
——, “Social media medical concept normalization using roberta in ontology enriched text similarity framework,” in Proceedings of Knowledgeable NLP: the First Workshop on Integrating Structured Knowledge and Neural Networks for NLP , 2020, pp. 21–26
2020
Later among the works it cites.
S. Henry, K. Buchan, M. Filannino, A. Stubbs, and O. Uzuner, “2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records,” Journal of the American Medical Informatics Association , vol. 27, no. 1, pp. 3–12, 2020
2020
Later among the works it cites.
A. E. Johnson, L. Bulgarelli, and T. J. Pollard, “Deidentification of free-text medical records using pre-trained bidirectional transformers,” in Proceedings of the ACM Conference on Health, Inference, and Learning , 2020, pp. 214–221
2020
Later among the works it cites.
M. Chen, F. Du, G. Lan, and V. S. Lobanov, “Using pre-trained transformer deep learning models to identify named entities and syntactic relations for clinical protocol analysis.” in AAAI Spring Symposium: Combining Machine Learning with Knowledge Engineering (1) , 2020
2020
Later among the works it cites.
F. W. Mutinda, S. Nigo, D. Shibata, S. Yada, S. Wakamiya, and E. Aramaki, “Detecting redundancy in electronic medical records using clinical bert,” 2020
2020
Later among the works it cites.
Y. Wang, F. Liu, K. Verspoor, and T. Baldwin, “Evaluating the utility of model configurations and data augmentation on clinical semantic textual similarity,” in Proceedings of the 19th SIGBioMed Workshop on Biomedical Language Processing , 2020, pp. 105–111
2020
Later among the works it cites.
Y. Xiong, S. Chen, Q. Chen, J. Yan, and B. Tang, “Using character-level and entity-level representations to enhance bidirectional encoder representation from transformers-based clinical semantic textual similarity model: Clinicalsts modeling study,” JMIR Medical Informatics , vol. 8, no. 12, p. e23357, 2020
2020
Later among the works it cites.
X. Liu, J. Fan, S. Dong et al. , “Document-level biomedical relation extraction leveraging pretrained self-attention structure and entity replacement: Algorithm and pretreatment method validation study,” JMIR Medical Informatics , vol. 8, no. 5, p. e17644, 2020
2020
Later among the works it cites.
P. Su and K. Vijay-Shanker, “Investigation of bert model on biomedical relation extraction based on revised fine-tuning mechanism,” in 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) . IEEE, 2020, pp. 2522–2529
2020
Later among the works it cites.
D. A. Wood, J. Lynch, S. Kafiabadi, E. Guilhem, A. Al Busaidi, A. Montvila, T. Varsavsky, J. Siddiqui, N. Gadapa, M. Townend et al. , “Automated labelling using an attention model for radiology reports of mri scans (alarm),” in Medical Imaging with Deep Learning . PMLR, 2020, pp. 811–826
2020
Later among the works it cites.
T. Möller, A. Reina, R. Jayakumar, and M. Pietsch, “Covid-qa: A question answering dataset for covid-19,” in Proceedings of the 1st Workshop on NLP for COVID-19 at ACL 2020 , 2020
2020
Later among the works it cites.
M. Zhu, A. Ahuja, D.-C. Juan, W. Wei, and C. K. Reddy, “Question answering with long multiple-span answers,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings , 2020, pp. 3840–3849
2020
Later among the works it cites.
S. Soni and K. Roberts, “Evaluation of dataset selection for pre-training and fine-tuning transformer language models for clinical question answering,” in Proceedings of The 12th Language Resources and Evaluation Conference , 2020, pp. 5532–5538
2020
Later among the works it cites.
A. Akdemir and T. Shibuya, “Transfer learning for biomedical question answering.” 2020
2020
Later among the works it cites.
M. Moradi, G. Dorffner, and M. Samwald, “Deep contextualized embeddings for quantifying the informative content in biomedical text summarization,” Computer methods and programs in biomedicine , vol. 184, p. 105117, 2020
2020
Later among the works it cites.
M. Moradi, M. Dashti, and M. Samwald, “Summarization of biomedical articles using domain-specific word embeddings and graph ranking,” Journal of Biomedical Informatics , vol. 107, p. 103452, 2020
2020
Later among the works it cites.
Y. Du, Q. Li, L. Wang, and Y. He, “Biomedical-domain pre-trained language model for extractive summarization,” Knowledge-Based Systems , vol. 199, p. 105964, 2020
2020
Later among the works it cites.
Y. Mao and K. W. Fung, “Use of word and graph embedding to measure semantic relatedness between unified medical language system concepts,” Journal of the American Medical Informatics Association , vol. 27, no. 10, pp. 1538–1546, 2020
2020
Later among the works it cites.
Y. Pruksachatkun, J. Phang, H. Liu, P. M. Htut, X. Zhang, R. Y. Pang, C. Vania, K. Kann, and S. Bowman, “Intermediate-task transfer learning with pretrained language models: When and why does it work?” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , 2020, pp. 5231–5247
2020
Later among the works it cites.
H. Yu, X.-L. Mao, Z. Chi, W. Wei, and H. Huang, “A robust and domain-adaptive approach for low-resource named entity recognition,” in 2020 IEEE International Conference on Knowledge Graph (ICKG) . IEEE, 2020, pp. 297–304
2020
Later among the works it cites.
D. Jin, Z. Jin, J. T. Zhou, and P. Szolovits, “Is bert really robust? a strong baseline for natural language attack on text classification and entailment,” in Proceedings of the AAAI conference on artificial intelligence , vol. 34, no. 05, 2020, pp. 8018–8025
2020
Later among the works it cites.
2020
Later among the works it cites.
2020
Later among the works it cites.
S. Hisamoto, M. Post, and K. Duh, “Membership inference attacks on sequence-to-sequence models: Is my data in your machine translation system?” Transactions of the Association for Computational Linguistics , vol. 8, pp. 49–63, 2020
2020
Later among the works it cites.
S. Aroca-Ouellette and F. Rudzicz, “On losses for modern language models,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , 2020, pp. 4970–4981
2020
Later among the works it cites.
Y. Liang, N. Duan, Y. Gong, N. Wu, F. Guo, W. Qi, M. Gong, L. Shou, D. Jiang, G. Cao et al. , “Xglue: A new benchmark datasetfor cross-lingual pre-training, understanding and generation,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , 2020, pp. 6008–6018
2020
Later among the works it cites.
G. Aguilar, S. Kar, and T. Solorio, “Lince: A centralized benchmark for linguistic code-switching evaluation,” in Proceedings of the 12th Language Resources and Evaluation Conference , 2020, pp. 1803–1813
2020
Later among the works it cites.
Z. Jiang, A. Anastasopoulos, J. Araki, H. Ding, and G. Neubig, “X-factr: Multilingual factual knowledge retrieval from pretrained language models,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , 2020, pp. 5943–5959
2020
Later among the works it cites.
Z.-H. Jiang, W. Yu, D. Zhou, Y. Chen, J. Feng, and S. Yan, “Convbert: Improving bert with span-based dynamic convolution,” Advances in Neural Information Processing Systems , vol. 33, 2020
2020
Later among the works it cites.
P. He, X. Liu, J. Gao, and W. Chen, “Deberta: Decoding-enhanced bert with disentangled attention,” in International Conference on Learning Representations , 2020
2020
Later among the works it cites.
2021
Closest in time.
L. Rasmy, Y. Xiang, Z. Xie, C. Tao, and D. Zhi, “Med-bert: pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction,” NPJ digital medicine , vol. 4, no. 1, pp. 1–13, 2021
2021
Closest in time.
Y. Meng, W. F. Speier, M. K. Ong, and C. Arnold, “Bidirectional representation learning from transformers using multimodal electronic health record data to predict depression,” IEEE Journal of Biomedical and Health Informatics , 2021
2021
Closest in time.
X. Liu, F. Zhang, Z. Hou, L. Mian, Z. Wang, J. Zhang, and J. Tang, “Self-supervised learning: Generative or contrastive,” IEEE Transactions on Knowledge and Data Engineering , 2021
2021
Closest in time.
2021
Closest in time.
G. Michalopoulos, Y. Wang, H. Kaka, H. Chen, and A. Wong, “Umlsbert: Clinical domain knowledge augmentation of contextual embeddings using the unified medical language system metathesaurus,” in Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , 2021, pp. 1744–1753
2021
Closest in time.
B. Portelli, E. Lenzi, E. Chersoni, G. Serra, and E. Santus, “Bert prescriptions to avoid unwanted headaches: A comparison of transformer architectures for adverse drug event detection,” in Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume , 2021, pp. 1740–1747
2021
Closest in time.
C. Sun, Z. Yang, L. Wang, Y. Zhang, H. Lin, and J. Wang, “Biomedical named entity recognition using bert in the machine reading comprehension framework,” Journal of Biomedical Informatics , vol. 118, p. 103799, 2021
2021
Closest in time.
S. Gao, O. Kotevska, A. Sorokine, and J. B. Christian, “A pre-training and self-training approach for biomedical named entity recognition,” PloS one , vol. 16, no. 2, p. e0246310, 2021
2021
Closest in time.
Y. Zhang and Q. Yang, “A survey on multi-task learning,” IEEE Transactions on Knowledge and Data Engineering , 2021
2021
Closest in time.
E. Tutubalina, I. Alimova, Z. Miftahutdinov, A. Sakhovskiy, V. Malykh, and S. Nikolenko, “The russian drug reaction corpus and neural models for drug reactions and effectiveness detection in user reviews,” Bioinformatics , vol. 37, no. 2, pp. 243–249, 2021
2021
Closest in time.
2021
Closest in time.
K. raj Kanakarajan, B. Kundumani, and M. Sankarasubbu, “Bioelectra: Pretrained biomedical text encoder using discriminators,” in Proceedings of the 20th Workshop on Biomedical Language Processing , 2021, pp. 143–154
2021
Closest in time.
2021
Closest in time.
N. Boudjellal, H. Zhang, A. Khan, A. Ahmad, R. Naseem, J. Shang, and L. Dai, “Abioner: a bert-based model for arabic biomedical named-entity recognition,” Complexity , vol. 2021, 2021
2021
Closest in time.
2021
Closest in time.
J. Wang, G. Zhang, W. Wang, K. Zhang, and Y. Sheng, “Cloud-based intelligent self-diagnosis and department recommendation service using chinese medical bert,” Journal of Cloud Computing , vol. 10, no. 1, pp. 1–12, 2021
2021
Closest in time.
2021
Closest in time.
G. López-García, J. M. Jerez, N. Ribelles, E. Alba, and F. J. Veredas, “Transformers for clinical coding in spanish,” IEEE Access , vol. 9, pp. 72 387–72 397, 2021
2021
Closest in time.
F. Liu, E. Shareghi, Z. Meng, M. Basaldella, and N. Collier, “Self-alignment pretraining for biomedical entity representations,” in Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , 2021, pp. 4228–4238
2021
Closest in time.
Z. Yuan, Y. Liu, C. Tan, S. Huang, and F. Huang, “Improving biomedical pretrained language models with knowledge,” in Proceedings of the 20th Workshop on Biomedical Language Processing , 2021, pp. 180–190
2021
Closest in time.
2021
Closest in time.
G. Liu, Y. Liao, F. Wang, B. Zhang, L. Zhang, X. Liang, X. Wan, S. Li, Z. Li, S. Zhang et al. , “Medical-vlbert: Medical visual language bert for covid-19 ct report generation with alternate learning,” IEEE Transactions on Neural Networks and Learning Systems , 2021
2021
Closest in time.
2021
Closest in time.
2021
Closest in time.
J. Du, Y. Xiang, M. Sankaranarayanapillai, M. Zhang, J. Wang, Y. Si, H. A. Pham, H. Xu, Y. Chen, and C. Tao, “Extracting postmarketing adverse events from safety reports in the vaccine adverse event reporting system (vaers) using deep learning,” Journal of the American Medical Informatics Association , 2021
2021
Closest in time.
T. Kang, A. Perotte, Y. Tang, C. Ta, and C. Weng, “Umls-based data augmentation for natural language processing of clinical research literature,” Journal of the American Medical Informatics Association , vol. 28, no. 4, pp. 812–823, 2021
2021
Closest in time.
M. A. Al-Garadi, Y.-C. Yang, H. Cai, Y. Ruan, K. O’Connor, G.-H. Graciela, J. Perrone, and A. Sarker, “Text classification models for the automatic detection of nonmedical prescription medication use from social media,” BMC medical informatics and decision making , vol. 21, no. 1, pp. 1–13, 2021
2021
Closest in time.
2021
Closest in time.
K. S. Kalyan and S. Sangeetha, “Bertmcn: Mapping colloquial phrases to standard medical concepts using bert and highway network,” Artificial Intelligence in Medicine , vol. 112, p. 102008, 2021
2021
Closest in time.
N. Mehrabi, F. Morstatter, N. Saxena, K. Lerman, and A. Galstyan, “A survey on bias and fairness in machine learning,” ACM Computing Surveys (CSUR) , vol. 54, no. 6, pp. 1–35, 2021
2021
Closest in time.
2021
Closest in time.
N. Kassner, P. Dufter, and H. Schütze, “Multilingual lama: Investigating knowledge in multilingual pretrained language models,” in Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume , 2021, pp. 3250–3258
2021
Closest in time.