Hoard: A Distributed Data Caching System to Accelerate Deep Learning Training on the Cloud

Caching in the Sprite network file system , volume 21

Nelson, M., Welch, B., and Ousterhout, J · 1987

Earlier work this paper cites.

dcache, a distributed storage data caching system

Ernst, M., Fuhrmann, P., Gasthuber, M., Mkrtchyan, T., and Waldman, C · 2001

Earlier work this paper cites.

Flexibility, manageability, and performance in a grid storage appliance

Bent, J., Venkataramani, V., LeRoy, N., Roy, A., Stanley, J., Arpaci-Dusseau, A. C., Arpaci-Dusseau, R. H., and Livny, M · 2002

Earlier work this paper cites.

Gpfs: A shared-disk file system for large computing clusters

Schmuck, F. B. and Haskin, R. L · 2002

Earlier work this paper cites.

Imagenet: A large-scale hierarchical image database

Deng, J., Dong, W., Socher, R., jia Li, L., Li, K., and Fei-fei, L · 2009

Earlier work this paper cites.

Panache: A parallel file system cache for global file access

Eshel, M., Haskin, R. L., Hildebrand, D., Naik, M., Schmuck, F. B., and Tewari, R · 2010

Earlier work this paper cites.

Using transparent compression to improve ssd-based i/o caches

Makatos, T., Klonatos, Y., Marazakis, M., Flouris, M. D., and Bilas, A · 2010

Earlier work this paper cites.

Glusterfs one storage server to rule them all

Boyer, E. B., Broomfield, M. C., and Perrotti, T. A · 2012

Earlier work this paper cites.

Mercury: Host-side flash caching for the data center

Byan, S., Lentini, J., Madan, A., Pabon, L., Condict, M., Kimmel, J., Kleiman, S., Small, C., and Storer, M · 2012

Earlier work this paper cites.

Flashtier: A lightweight, consistent and durable storage cache

Saxena, M., Swift, M. M., and Zhang, Y · 2012

Earlier work this paper cites.

Caffe: Convolutional architecture for fast feature embedding

Original

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T · 2014

Earlier work this paper cites.

TensorFlow: Large-scale machine learning on heterogeneous systems, 2015

Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Levenberg, J., Mané, D., Monga, R., Moore, S., Murray, D., Olah, C., Schuster, M., Shlens, J., Steiner, B., Sutskever, I., Talwar, K., Tucker, P., Vanhoucke, V., Vasudevan, V., Viégas, F., Vinyals, O., Warden, P., Wattenberg, M., Wicke, M., Yu, Y., and Zheng, X · 2015

Cited alongside, same era.

IBM deep learning service

Bhattacharjee, B., Boag, S., Doshi, C., Dube, P., Herta, B., Ishakian, V., Jayaram, K., Khalaf, R., Krishna, A., Li, Y. B., et al · 2017

Cited alongside, same era.

Openimages: A public dataset for large-scale multi-label and multi-class image classification

Krasin, I., Duerig, T., Alldrin, N., Ferrari, V., Abu-El-Haija, S., Kuznetsova, A., Rom, H., Uijlings, J., Popov, S., Kamali, S., Malloci, M., Pont-Tuset, J., Veit, A., Belongie, S., Gomes, V., Gupta, A., Sun, C., Chechik, G., Cai, D., Feng, Z., Narayanan, D., and Murphy, K · 2017

Cited alongside, same era.

Distributed training large-scale deep architectures

Original

Zou, S.-X., Chen, C.-Y., Wu, J.-L., Chou, C.-N., Tsao, C.-C., Tung, K.-C., Lin, T.-W., Sung, C.-L., and Chang, E. Y · 2017

Cited alongside, same era.

Distributed Deep Learning with Containers on Heterogeneous GPU clusters

Meng, D · 2018

Closest in time.

NVIDIA DGX SYSTEMS

Nvidia DGX · 2018

Closest in time.

NVIDIA HGX-2 SYSTEMS

Nvidia HGX · 2018

Closest in time.

TESLA P100 PERFORMANCE GUIDE

NVidia P100 · 2018

Closest in time.

TESLA V100 PERFORMANCE GUIDE

NVidia V100 · 2018

Closest in time.

Nvidia NVLink website

NVLink Fabric · 2018

Closest in time.

Paperspace web page

Paperspace · 2018

Closest in time.

Amazon S3 API Documentation