Exploring Hidden Dimensions in Parallelizing Convolutional Neural Networks

Face recognition: A convolutional neural-network approach

Lawrence, S., Giles, C. L., Tsoi, A. C., and Back, A. D · 1997

Earlier work this paper cites.

ImageNet: A large-scale hierarchical image database

Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L · 2009

Earlier work this paper cites.

Legion: Expressing locality and independence with logical regions

Bauer, M., Treichler, S., Slaughter, E., and Aiken, A · 2012

Earlier work this paper cites.

Large scale distributed deep networks

Dean, J., Corrado, G. S., Monga, R., Chen, K., Devin, M., Le, Q. V., Mao, M. Z., Ranzato, M., Senior, A., Tucker, P., Yang, K., and Ng, A. Y · 2012

Earlier work this paper cites.

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., and Hinton, G. E · 2012

Earlier work this paper cites.

End-to-end text recognition with convolutional neural networks

Wang, T., Wu, D. J., Coates, A., and Ng, A. Y · 2012

Earlier work this paper cites.

cudnn: Efficient primitives for deep learning

Original

Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J., Catanzaro, B., and Shelhamer, E · 2014

Earlier work this paper cites.

One weird trick for parallelizing convolutional neural networks

Original

Krizhevsky, A · 2014

Earlier work this paper cites.

Very deep convolutional networks for large-scale image recognition

Original

Simonyan, K. and Zisserman, A · 2014

Cited alongside, same era.

Realm: An event-based low-level runtime for distributed memory architectures

Treichler, S., Bauer, M., and Aiken, A · 2014

Cited alongside, same era.

Visualizing and understanding convolutional networks

Zeiler, M. D. and Fergus, R · 2014

Cited alongside, same era.

Learning both weights and connections for efficient neural networks

Han, S., Pool, J., Tran, J., and Dally, W. J · 2015

Cited alongside, same era.

https://developer.nvidia.com/cublas , 2016

Dense Linear Algebra on GPUs · 2016

Cited alongside, same era.

Tensorflow: A system for large-scale machine learning

Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., Kudlur, M., Levenberg, J., Monga, R., Moore, S., Murray, D. G., Steiner, B., Tucker, P., Vasudevan, V., Warden, P., Wicke, M., Yu, Y., and Zheng, X · 2016

Mastering the game of go with deep neural networks and tree search

Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al · 2016

Later among the works it cites.

Rethinking the inception architecture for computer vision

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z · 2016

Later among the works it cites.

Accurate, large minibatch SGD: training imagenet in 1 hour

Original

Goyal, P., Dollár, P., Girshick, R. B., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., and He, K · 2017

Later among the works it cites.

A distributed multi-gpu system for fast graph processing

Jia, Z., Kwon, Y., Shipman, G., McCormick, P., Erez, M., and Aiken, A · 2017

Later among the works it cites.

SplitNet: Learning to semantically split deep networks for parameter reduction and model parallelization

Kim, J., Park, Y., Kim, G., and Hwang, S. J · 2017

Later among the works it cites.