Accelerating Data Loading in Deep Neural Network Training

M. Raab and A. Steger, “Balls into bins—a simple and tight analysis,” in International Workshop on Randomization and Approximation Techniques in Computer Science . Springer, 1998, pp. 159–170

1998

Earlier work this paper cites.

X. Chen, L. Liu, Z. Liu, and T. Jiang, “On the minimum common integer partition problem,” ACM Transactions on Algorithms (TALG) , vol. 5, no. 1, p. 12, 2008

2008

Earlier work this paper cites.

O. Dekel, R. Gilad-Bachrach, O. Shamir, and L. Xiao, “Optimal distributed online prediction using mini-batches,” Journal of Machine Learning Research , vol. 13, no. Jan, pp. 165–202, 2012

2012

Earlier work this paper cites.

K. Soomro, A. Roshan Zamir, and M. Shah, “UCF101: A dataset of 101 human actions classes from videos in the wild,” in CRCV-TR-12-01 , 2012

2012

Earlier work this paper cites.

S. Chetlur, C. Woolley, P. Vandermersch, J. Cohen, J. Tran, B. Catanzaro, and E. Shelhamer, “cudnn: Efficient primitives for deep learning,” arXiv preprint arXiv:1410.0759 , 2014

Original

2014

Earlier work this paper cites.

Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, “Caffe: Convolutional architecture for fast feature embedding,” arXiv preprint arXiv:1408.5093 , 2014

Original

2014

Earlier work this paper cites.

M. Abadi et al. , “TensorFlow: Large-scale machine learning on heterogeneous systems,” 2015, software available from tensorflow.org. [Online]. Available: https://www.tensorflow.org/

2015

Earlier work this paper cites.

O. Russakovsky et al. , “ImageNet Large Scale Visual Recognition Challenge,” International Journal of Computer Vision (IJCV) , vol. 115, no. 3, pp. 211–252, 2015

2015

Earlier work this paper cites.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770–778

2016

Cited alongside, same era.

N. P. Jouppi et al. , “In-datacenter performance analysis of a tensor processing unit,” in Computer Architecture (ISCA), 2017 ACM/IEEE 44th Annual International Symposium on . IEEE, 2017, pp. 1–12

2017

Cited alongside, same era.

A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer, “Automatic differentiation in pytorch,” in NIPS-W , 2017

2017

Cited alongside, same era.

P. Goyal, P. Dollár, R. Girshick, P. Noordhuis, L. Wesolowski, A. Kyrola, A. Tulloch, Y. Jia, and K. He, “Accurate, large minibatch sgd: training imagenet in 1 hour,” arXiv preprint arXiv:1706.02677 , 2017

Original

2017

Cited alongside, same era.

H. Mikami, H. Suganuma, P. U-chupala, Y. Tanaka, and Y. Kageyama, “Imagenet/resnet-50 training in 224 seconds,” 2018

2018

Later among the works it cites.

T. Kurth, S. Treichler, J. Romero, M. Mudigonda, N. Luehr, E. Phillips, A. Mahesh, M. Matheson, J. Deslippe et al. , “Exascale deep learning for climate analytics,” in Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis . IEEE Press, 2018, p. 51

2018

Later among the works it cites.

A. Sergeev and M. D. Balso, “Horovod: fast and easy distributed deep learning in tensorflow,” 2018

2018

Later among the works it cites.

Y. Zhu, F. Chowdhury, H. Fu, A. Moody, K. Mohror, K. Sato, and W. Yu, “Entropy-aware i/o pipelining for large-scale deep learning on hpc systems,” in 2018 IEEE 26th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS) . IEEE, 2018, pp. 145–156

2018

Later among the works it cites.