Fetching the paper…
Reading the bibliography…
Pervasive mobile AI applications primarily employ one of the two learning paradigms: cloud-based learning (with powerful large models) or on-device learning (with lightweight small models).
Adaptive Mixtures of Local Experts
Robert A. Jacobs, Michael I. Jordan, Steven J. Nowlan, and Geoffrey E. Hinton. 1991 · 1991
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
A public domain dataset for human activity recognition using smartphones. In Proceedings of the 21th international European symposium on artificial neural networks, computational intelligence and machine learning (ESANN)
Davide Anguita, Alessandro Ghio, Luca Oneto, Xavier Parra Perez, and Jorge Luis Reyes Ortiz. 2013 · 2013
Earlier work this paper cites.
Mixture of experts: a literature survey
Saeed Masoudnia and Reza Ebrahimpour. 2014 · 2014
Earlier work this paper cites.
Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding. In International Conference on Learning Representations (ICLR)
Song Han, Huizi Mao, and William J. Dally. 2015 · 2015
Earlier work this paper cites.
Distilling the knowledge in a neural network
Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015 · 2015
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition. In International Conference on Learning Representations (ICLR)
Karen Simonyan and Andrew Zisserman. 2015 · 2015
Earlier work this paper cites.
Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016 · 2016
Earlier work this paper cites.
Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile Applications. In International Conference on Learning Representations (ICLR)
Yong-Deok Kim, Eunhyeok Park, Sungjoo Yoo, Taelim Choi, Lu Yang, and Dongjun Shin. 2016 · 2016
Earlier work this paper cites.
Cross-Stitch Networks for Multi-task Learning. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Ishan Misra, Abhinav Shrivastava, Abhinav Gupta, and Martial Hebert. 2016 · 2016
Earlier work this paper cites.
Branchynet: Fast inference via early exiting from deep neural networks. In 2016 23rd International Conference on Pattern Recognition (ICPR) . IEEE
Surat Teerapittayanon, Bradley McDanel, and Hsiang-Tsung Kung. 2016 · 2016
Earlier work this paper cites.
Learning Structured Sparsity in Deep Neural Networks. In Proceedings of the 30th International Conference on Neural Information Processing Systems (NeurIPS)
Wei Wen, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li. 2016 · 2016
Earlier work this paper cites.
QSGD: Communication-efficient SGD via gradient quantization and encoding
Dan Alistarh, Demjan Grubic, Jerry Li, Ryota Tomioka, and Milan Vojnovic. 2017 · 2017
Earlier work this paper cites.
Adaptive neural networks for efficient inference. In International Conference on Machine Learning (ICML) . PMLR
Tolga Bolukbasi, Joseph Wang, Ofer Dekel, and Venkatesh Saligrama. 2017 · 2017
Earlier work this paper cites.
Learning without forgetting
Zhizhong Li and Derek Hoiem. 2017 · 2017
Earlier work this paper cites.
Runtime Neural Pruning. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS)
Ji Lin, Yongming Rao, Jiwen Lu, and Jie Zhou. 2017 · 2017
Earlier work this paper cites.
Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics (AISTATS) . PMLR
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017 · 2017
Earlier work this paper cites.
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. In International Conference on Learning Representations (ICLR)
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean. 2017 · 2017
Earlier work this paper cites.
Attention is All you Need. In Advances in Neural Information Processing Systems (NeurIPS)
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
MobileDeepPill: A Small-Footprint Mobile Deep Learning System for Recognizing Unconstrained Pill Images. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys)
Xiao Zeng, Kai Cao, and Mi Zhang. 2017 · 2017
Earlier work this paper cites.
Expanding the reach of federated learning by reducing client resource requirements
Sebastian Caldas, Jakub Konečny, H Brendan McMahan, and Ameet Talwalkar. 2018 · 2018
Earlier work this paper cites.
NestDNN: Resource-Aware Multi-Tenant On-Device Deep Learning for Continuous Mobile Vision. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (MobiCom)
Biyi Fang, Xiao Zeng, and Mi Zhang. 2018 · 2018
Earlier work this paper cites.
Distributed learning of deep neural network over multiple agents
Otkrist Gupta and Ramesh Raskar. 2018 · 2018
Earlier work this paper cites.
Multi-Scale Dense Networks for Resource Efficient Image Classification. In International Conference on Learning Representations (ICLR)
Gao Huang, Danlu Chen, Tianhong Li, Felix Wu, Laurens van der Maaten, and Kilian Weinberger. 2018 · 2018
Earlier work this paper cites.
Modular Networks: Learning to Decompose Neural Computation. In Proceedings of the 32nd International Conference on Neural Information Processing Systems (NeurIPS)
Louis Kirsch, Julius Kunze, and David Barber. 2018 · 2018
Earlier work this paper cites.
Self-Governing Neural Networks for On-Device Short Text Classification. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Sujith Ravi and Zornitsa Kozareva. 2018 · 2018
Cited alongside, same era.
Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)
Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. 2018 · 2018
Cited alongside, same era.
Split learning for health: Distributed deep learning without sharing raw patient data
Praneeth Vepakomma, Otkrist Gupta, Tristan Swedish, and Ramesh Raskar. 2018 · 2018
Cited alongside, same era.
Skipnet: Learning dynamic routing in convolutional networks. In Proceedings of the European Conference on Computer Vision (ECCV)
Xin Wang, Fisher Yu, Zi-Yi Dou, Trevor Darrell, and Joseph E Gonzalez. 2018 · 2018
Cited alongside, same era.
OR-Tools: Operations Research Tools
Google LLC. 2021 · 2021
Later among the works it cites.
LegoDNN: Block-Grained Scaling of Deep Neural Networks for Mobile Vision. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking (MobiCom)
Rui Han, Qinglong Zhang, Chi Harold Liu, Guoren Wang, Jian Tang, and Lydia Y. Chen. 2021 · 2021
Later among the works it cites.
FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropout. In Proceedings of the 35th International Conference on Neural Information Processing Systems (NeurIPS)
Samuel Horvath, Stefanos Laskaridis, Mario Almeida, Ilias Leontiadis, Stylianos Venieris, and Nicholas Donald Lane. 2021 · 2021
Later among the works it cites.
Distillation-based semi-supervised federated learning for communication-efficient collaborative training with non-iid private data
Sohei Itahara, Takayuki Nishio, Yusuke Koda, Masahiro Morikura, and Koji Yamamoto. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Pete Warden. 2018 · 2018
Cited alongside, same era.
Blockdrop: Dynamic inference paths in residual networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)
Zuxuan Wu, Tushar Nagarajan, Abhishek Kumar, Steven Rennie, Larry S Davis, Kristen Grauman, and Rogerio Feris. 2018 · 2018
Cited alongside, same era.
Deep learning for sentiment analysis: A survey
Lei Zhang, Shuai Wang, and Bing Liu. 2018 · 2018
Cited alongside, same era.
Federated Learning with Non-IID Data
Yue Zhao, Meng Li, Liangzhen Lai, Naveen Suda, Damon Civin, and Vikas Chandra. 2018 · 2018
Cited alongside, same era.
Il2m: Class incremental learning with dual memory. In Proceedings of the IEEE/CVF international conference on computer vision (CVPR)
Eden Belouadah and Adrian Popescu. 2019 · 2019
Cited alongside, same era.
Searching for mobilenetv3. In Proceedings of the IEEE/CVF international conference on computer vision (ICCV)
Andrew Howard, Mark Sandler, Grace Chu, Liang-Chieh Chen, Bo Chen, Mingxing Tan, Weijun Wang, Yukun Zhu, Ruoming Pang, Vijay Vasudevan, et al · 2019
Cited alongside, same era.
Fedmd: Heterogenous federated learning via model distillation
Daliang Li and Junpu Wang. 2019 · 2019
Cited alongside, same era.
Edge Assisted Real-Time Object Detection for Mobile Augmented Reality. In The 25th Annual International Conference on Mobile Computing and Networking (MobiCom)
Luyang Liu, Hongyu Li, and Marco Gruteser. 2019 · 2019
Cited alongside, same era.
Hermes: an efficient federated learning framework for heterogeneous mobile clients. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking (MobiCom)
Ang Li, Jingwei Sun, Pengcheng Li, Yu Pu, Hai Li, and Yiran Chen. 2021 · 2021
Later among the works it cites.
AdaSpring: Context-Adaptive and Runtime-Evolutionary Deep Model Compression for Mobile Applications
Sicong Liu, Bin Guo, Ke Ma, Zhiwen Yu, and Junzhao Du. 2021 · 2021
Later among the works it cites.
ClusterFL: A Similarity-Aware Federated Learning System for Human Activity Recognition. In Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys)
Xiaomin Ouyang, Zhiyuan Xie, Jiayu Zhou, Jianwei Huang, and Guoliang Xing. 2021 · 2021
Later among the works it cites.
Efficientnetv2: Smaller models and faster training. In International conference on machine learning (ICML)
Mingxing Tan and Quoc Le. 2021 · 2021
Later among the works it cites.
FedDL: Federated Learning via Dynamic Layer Sharing for Human Activity Recognition. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems (SenSys)
Linlin Tu, Xiaomin Ouyang, Jiayu Zhou, Yuze He, and Guoliang Xing. 2021 · 2021
Later among the works it cites.
Context-Aware Adaptive Surgery: A Fast and Effective Framework for Adaptative Model Partition
Hongli Wang, Bin Guo, Jiaqi Liu, Sicong Liu, Yungang Wu, and Zhiwen Yu. 2021 · 2021
Later among the works it cites.
Device-Cloud Collaborative Learning for Recommendation. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining (SIGKDD)
Jiangchao Yao, Feng Wang, Kunyang Jia, Bo Han, Jingren Zhou, and Hongxia Yang. 2021 · 2021
Later among the works it cites.
AI Benchmark: All About Deep Learning on Smart phones
2022 · 2022
Later among the works it cites.
FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extraction. In Advances in Neural Information Processing Systems (NeurIPS)
Samiul Alam, Luyang Liu, Ming Yan, and Mi Zhang. 2022 · 2022
Later among the works it cites.
Ekya: Continuous learning of video analytics models on edge compute servers. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 2022)
Romil Bhardwaj, Zhengxu Xia, Ganesh Ananthanarayanan, Junchen Jiang, Yuanchao Shu, Nikolaos Karianakis, Kevin Hsieh, Paramvir Bahl, and Ion Stoica. 2022 · 2022
Later among the works it cites.
Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence (IJCAI)
Yae Jee Cho, Andre Manoel, Gauri Joshi, Robert Sim, and Dimitrios Dimitriadis. 2022 · 2022
Later among the works it cites.
Model elasticity for hardware heterogeneity in federated learning systems. In Proceedings of the 1st ACM Workshop on Data Privacy and Federated Learning Technologies for Mobile Edge Network (MobiCom FedEdge)
Allen-Jasmin Farcas, Xiaohan Chen, Zhangyang Wang, and Radu Marculescu. 2022 · 2022
Later among the works it cites.
Efficient Split-Mix Federated Learning for On-Demand and In-Situ Customization. In International Conference on Learning Representations (ICLR)
Junyuan Hong, Haotao Wang, Zhangyang Wang, and Jiayu Zhou. 2022 · 2022
Later among the works it cites.
DistFL: Distribution-Aware Federated Learning for Mobile Scenarios
Bingyan Liu, Yifeng Cai, Ziqi Zhang, Yuanchun Li, Leye Wang, Ding Li, Yao Guo, and Xiangqun Chen. 2022a · 2022
Later among the works it cites.
Walle: An End-to-End, General-Purpose, and Large-Scale Production System for Device-Cloud Collaborative Machine Learning. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22)
Chengfei Lv, Chaoyue Niu, Renjie Gu, Xiaotang Jiang, Zhaode Wang, Bin Liu, Ziqi Wu, Qiulin Yao, Congyu Huang, Panos Huang, Tao Huang, Hui Shu, Jinde Song, Bin Zou, Peng Lan, Guohuan Xu, Fei Wu, Shaojie Tang, Fan Wu, and Guihai Chen. 2022 · 2022
Later among the works it cites.
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI
Jiangchao Yao, Shengyu Zhang, Yang Yao, Feng Wang, Jianxin Ma, Jianwei Zhang, Yunfei Chu, Luo Ji, Kunyang Jia, Tao Shen, Anpeng Wu, Fengda Zhang, Ziqi Tan, Kun Kuang, Chao Wu, Fei Wu, Jingren Zhou, and Hongxia Yang. 2022 · 2022
Later among the works it cites.
Federated analytics: A survey
Ahmed Roushdy Elkordy, Yahya H Ezzeldin, Shanshan Han, Shantanu Sharma, Chaoyang He, Sharad Mehrotra, Salman Avestimehr, et al · 2023
Closest in time.
Hierarchical Clustering-Based Personalized Federated Learning for Robust and Fair Human Activity Recognition
Youpeng Li, Xuyu Wang, and Lingling An. 2023 · 2023
Closest in time.
GEMEL: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge. In Symposium on Networked Systems Design and Implementation (NSDI)
Arthi Padmanabhan, Neil Agarwal, Anand Iyer, Ganesh Ananthanarayanan, Yuanchao Shu, Nikolaos Karianakis, Guoqing Harry Xu, and Ravi Netravali. 2023 · 2023
Closest in time.
AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking (MobiCom)
Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, and Yunxin Liu. 2023 · 2023
Closest in time.