Placeto: Learning Generalizable Device Placement Algorithms for Distributed Machine Learning

Simple statistical gradient-following algorithms for connectionist reinforcement learning

R. J. Williams · 1992

Earlier work this paper cites.

Introduction to Reinforcement Learning

R. S. Sutton and A. G. Barto · 1998

Earlier work this paper cites.

Policy invariance under reward transformations: Theory and application to reward shaping

A. Y. Ng, D. Harada, and S. J. Russell · 1999

Earlier work this paper cites.

Variance reduction techniques for gradient estimates in reinforcement learning

E. Greensmith, P. L. Bartlett, and J. Baxter · 2004

Earlier work this paper cites.

A parallelisable multi-level banded diffusion scheme for computing balanced partitions with smooth boundaries

F. Pellegrini · 2007

Earlier work this paper cites.

Massively parallel methods for deep reinforcement learning

Original

A. Nair, P. Srinivasan, S. Blackwell, C. Alcicek, R. Fearon, A. De Maria, V. Panneershelvam, M. Suleyman, C. Beattie, S. Petersen, et al · 2015

Earlier work this paper cites.

Rethinking the inception architecture for computer vision

C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna · 2016

Earlier work this paper cites.

Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation

Y. Wu, M. Schuster, Z. Chen, Q. V. Le, M. Norouzi, W. Macherey, M. Krikun, Y. Cao, Q. Gao, K. Macherey, J. Klingner, A. Shah, M. Johnson, X. Liu, Ł. Kaiser, S. Gouws, Y. Kato, T. Kudo, H. Kazawa, K. Stevens, G. Kurian, N. Patil, W. Wang, C. Young, J. Smith, J. Riesa, A. Rudnick, O. Vinyals, G. Corrado, M. Hughes, and J. Dean · 2016

Earlier work this paper cites.

Hindsight experience replay

M. Andrychowicz, F. Wolski, A. Ray, J. Schneider, R. Fong, P. Welinder, B. McGrew, J. Tobin, O. P. Abbeel, and W. Zaremba · 2017

Cited alongside, same era.

Geometric deep learning: going beyond euclidean data

M. M. Bronstein, J. Bruna, Y. LeCun, A. Szlam, and P. Vandergheynst · 2017

Cited alongside, same era.

Inductive representation learning on large graphs

W. Hamilton, Z. Ying, and J. Leskovec · 2017

Cited alongside, same era.

Device placement optimization with reinforcement learning

A. Mirhoseini, H. Pham, Q. Le, M. Norouzi, S. Bengio, B. Steiner, Y. Zhou, N. Kumar, R. Larsen, and J. Dean · 2017

Cited alongside, same era.

Mastering the game of go without human knowledge

D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton, et al · 2017

Cited alongside, same era.

Tensorflow official repository, 2017

Tensorflow contributors · 2017

Cited alongside, same era.

Relational inductive biases, deep learning, and graph networks

Original

P. W. Battaglia et al · 2018

Later among the works it cites.

Spotlight: Optimizing device placement for training deep neural networks

Y. Gao, L. Chen, and B. Li · 2018

Later among the works it cites.

Learning scheduling algorithms for data processing clusters

Original

H. Mao, M. Schwarzkopf, S. B. Venkatakrishnan, Z. Meng, and M. Alizadeh · 2018

Later among the works it cites.

A hierarchical model for device placement

A. Mirhoseini, A. Goldie, H. Pham, B. Steiner, Q. V. Le, and J. Dean · 2018

Later among the works it cites.

Onnx model zoo, 2018

ONNX Developers · 2018

Later among the works it cites.

Efficient neural architecture search via parameter sharing