Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Models

Docbert: BERT for document classification

Original

Ashutosh Adhikari, Achyudh Ram, Raphael Tang, and Jimmy Lin · 1904

Earlier work this paper cites.

Publicly available clinical BERT embeddings

Original

Emily Alsentzer, John R. Murphy, Willie Boag, Wei-Hung Weng, Di Jin, Tristan Naumann, and Matthew B. A. McDermott · 1904

Earlier work this paper cites.

Identifying smokers with a medical extraction system

Cheryl Clark, Kathleen Good, Lesley Jezierny, Melissa Macpherson, Brian Wilson, and Urszula Chajewska · 2008

Earlier work this paper cites.

Identifying patient smoking status from medical discharge records

Özlem Uzuner, Ira Goldstein, Yuan Luo, and Isaac Kohane · 2008

Earlier work this paper cites.

Semantic classification of diseases in discharge summaries using a context-aware rule-based classifier

Illés Solt, Domonkos Tikk, Viktor Gál, and Zsolt T Kardkovács · 2009

Earlier work this paper cites.

Recognizing obesity and comorbidities in sparse data

Özlem Uzuner · 2009

Earlier work this paper cites.

Natural language processing framework to assess clinical conditions

Henry Ware, Charles J Mullett, and Vasudevan Jagannathan · 2009

Cited alongside, same era.

Dropout: a simple way to prevent neural networks from overfitting

Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov · 2014

Cited alongside, same era.

Google’s neural machine translation system: Bridging the gap between human and machine translation, 2016

Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean · 2016

Cited alongside, same era.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017

Cited alongside, same era.

Deep contextualized word representations

Original

Clinical text classification with rule-based features and knowledge-guided convolutional neural networks

Liang Yao, Chengsheng Mao, and Yuchen Luo · 2018

Later among the works it cites.

Transformer-xl: Attentive language models beyond a fixed-length context

Original

Zihang Dai, Zhilin Yang, Yiming Yang, William W Cohen, Jaime Carbonell, Quoc V Le, and Ruslan Salakhutdinov · 2019

Closest in time.

BERT: pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019

Closest in time.

A clinical text classification paradigm using weak supervision and deep representation

Yanshan Wang, Sunghwan Sohn, Sijia Liu, Feichen Shen, Liwei Wang, Elizabeth J Atkinson, Shreyasee Amin, and Hongfang Liu · 2019

Closest in time.

Beto, bentz, becas: The surprising cross-lingual effectiveness of bert

Shijie Wu and Mark Dredze · 2019

Closest in time.