MLPerf Mobile Inference Benchmark

Big.LITTLE

Arm · 2011

Earlier work this paper cites.

Google Play

Google · 2012

Earlier work this paper cites.

Imagenet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., and Hinton, G. E · 2012

Earlier work this paper cites.

Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture, 2015

Eigen, D. and Fergus, R · 2015

Earlier work this paper cites.

Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding

Original

Han, S., Mao, H., and Dally, W. J · 2015

Earlier work this paper cites.

Deep residual learning for image recognition, 2015

He, K., Zhang, X., Ren, S., and Sun, J · 2015

Earlier work this paper cites.

Microsoft coco: Common objects in context, 2015

Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., and Dollár, P · 2015

Earlier work this paper cites.

Fully convolutional networks for semantic segmentation, 2015

Long, J., Shelhamer, E., and Darrell, T · 2015

Earlier work this paper cites.

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., and Fei-Fei, L · 2015

Earlier work this paper cites.

Rethinking the inception architecture for computer vision, 2015

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z · 2015

Earlier work this paper cites.

Roadmap - ieee irds™

IRDS · 2016

Earlier work this paper cites.

Ssd: Single shot multibox detector

Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A. C · 2016

Earlier work this paper cites.

Squad: 100,000+ questions for machine comprehension of text, 2016

Rajpurkar, P., Zhang, J., Lopyrev, K., and Liang, P · 2016

Earlier work this paper cites.

Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs, 2017

Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A. L · 2017

Earlier work this paper cites.

Neural Networks API Drivers

Google · 2017

Earlier work this paper cites.

Mobilenets: Efficient convolutional neural networks for mobile vision applications, 2017

Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H · 2017

Earlier work this paper cites.

Scene parsing through ade20k dataset

Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., and Torralba, A · 2017

Cited alongside, same era.

https://play.google.com/store/apps/details?id=com.ludashi.aibench&hl=en_US , 2018

AImark · 2018

Cited alongside, same era.

Encoder-decoder with atrous separable convolution for semantic image segmentation, 2018

Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H · 2018

Cited alongside, same era.

Streaming end-to-end speech recognition for mobile devices, 2018

He, Y., Sainath, T. N., Prabhavalkar, R., McGraw, I., Alvarez, R., Zhao, D., Rybach, D., Kannan, A., Wu, Y., Pang, R., Liang, Q., Bhatia, D., Shangguan, Y., Li, B., Pundak, G., Sim, K. C., Bagby, T., yiin Chang, S., Rao, K., and Gruenstein, A · 2018

Cited alongside, same era.

Mobile AI Bench

Xiaomi · 2018

Cited alongside, same era.

http://ai-benchmark.com/ , 2019

AI-Benchmark · 2019

Willow cove - microarchitectures - intel

Intel · 2020

Closest in time.

The open images dataset v4

Kuznetsova, A., Rom, H., Alldrin, N., Uijlings, J., Krasin, I., Pont-Tuset, J., Kamali, S., Popov, S., Malloci, M., Kolesnikov, A., and et al · 2020

Closest in time.

7.1 a 3.4-to-13.3 tops/w 3.6 tops dual-core deep-learning accelerator for versatile ai applications in 7nm 5g smartphone soc

Lin, C.-H., Cheng, C.-C., Tsai, Y.-M., Hung, S.-J., Kuo, Y.-T., Wang, P. H., Tsung, P.-K., Hsu, J.-Y., Lai, W.-C., Liu, C.-H., et al · 2020

Closest in time.

MediaTek Dimensity 820

MediaTek · 2020

Closest in time.

Snapdragon 865+ 5G Mobile Platform

Qualcomm · 2020

Closest in time.

Mlperf inference benchmark, 2020

Reddi, V. J., Cheng, C., Kanter, D., Mattson, P., Schmuelling, G., Wu, C.-J., Anderson, B., Breughe, M., Charlebois, M., Chou, W., Chukka, R., Coleman, C., Davis, S., Deng, P., Diamos, G., Duke, J., Fick, D., Gardner, J. S., Hubara, I., Idgunji, S., Jablin, T. B., Jiao, J., John, T. S., Kanwar, P., Lee, D., Liao, J., Lokhmotov, A., Massa, F., Meng, P., Micikevicius, P., Osborne, C., Pekhimenko, G., Rajan, A. T. R., Sequeira, D., Sirasao, A., Sun, F., Tang, H., Thomson, M., Wei, F., Wu, E., Xu, L., Yamada, K., Yu, B., Yuan, G., Zhong, A., Zhang, P., and Zhou, Y · 2020