Pre-training of Graph Augmented Transformers for Medication Recommendation

A fast learning algorithm for deep belief nets

Geoffrey E Hinton, Simon Osindero, and Yee-Whye Teh · 2006

Earlier work this paper cites.

Why does unsupervised pre-training help deep learning?

Dumitru Erhan, Yoshua Bengio, Aaron Courville, Pierre-Antoine Manzagol, Pascal Vincent, and Samy Bengio · 2010

Earlier work this paper cites.

Binary relevance efficacy for multilabel classification

Oscar Luaces, Jorge Díez, José Barranquero, Juan José del Coz, and Antonio Bahamonde · 2012

Earlier work this paper cites.

On the properties of neural machine translation: Encoder-decoder approaches

Original

Kyunghyun Cho, Bart Van Merriënboer, Dzmitry Bahdanau, and Yoshua Bengio · 2014

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik P. Kingma and Jimmy Ba · 2014

Earlier work this paper cites.

Learning to diagnose with lstm recurrent neural networks

Original

Zachary C Lipton, David C Kale, Charles Elkan, and Randall Wetzel · 2015

Earlier work this paper cites.

Retain: An interpretable predictive model for healthcare using reverse time attention mechanism

Edward Choi, Mohammad Taha Bahadori, Jimeng Sun, Joshua Kulas, Andy Schuetz, and Walter Stewart · 2016

Earlier work this paper cites.

Mimic-iii, a freely accessible critical care database

Alistair EW Johnson, Tom J Pollard, Lu Shen, H Lehman Li-wei, Mengling Feng, Mohammad Ghassemi, Benjamin Moody, Peter Szolovits, Leo Anthony Celi, and Roger G Mark · 2016

Earlier work this paper cites.

Unsupervised pretraining for sequence to sequence learning

Original

Prajit Ramachandran, Peter J Liu, and Quoc V Le · 2016

Earlier work this paper cites.

Patient subtyping via time-aware lstm networks

Inci M. Baytas, Cao Xiao, Xi Zhang, Fei Wang, Anil K. Jain, and Jiayu Zhou · 2017

Cited alongside, same era.

Gram: Graph-based attention model for healthcare representation learning

Edward Choi, Mohammad Taha Bahadori, Le Song, Walter F Stewart, and Jimeng Sun · 2017

Cited alongside, same era.

Neural message passing for quantum chemistry

J. Gilmer, S.S. Schoenholz, P.F. Riley, O. Vinyals, and G.E. Dahl · 2017

Cited alongside, same era.

Semi-supervised classification with graph convolutional networks

Thomas N Kipf and Max Welling · 2017

Cited alongside, same era.

Automatic differentiation in pytorch

Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer · 2017

Cited alongside, same era.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017

Mime: Multilevel medical embedding of electronic health records for predictive healthcare

Edward Choi, Cao Xiao, Walter Stewart, and Jimeng Sun · 2018

Later among the works it cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Original

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018

Later among the works it cites.

Health-atm: A deep architecture for multifaceted patient health record representation and risk prediction

Tengfei Ma, Cao Xiao, and Fei Wang · 2018

Later among the works it cites.

Deep contextualized word representations

Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer · 2018

Later among the works it cites.

Improving language understanding by generative pre-training

Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever · 2018

Later among the works it cites.