PocketLLM: Enabling On-Device Fine-Tuning for Personalized LLMs

Multivariate stochastic approximation using a simultaneous perturbation gradient approximation

James C Spall. 1992 · 1992

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik P Kingma and Jimmy Ba. 2014 · 2014

Earlier work this paper cites.

The eu general data protection regulation (gdpr)

Paul Voigt and Axel Von dem Bussche. 2017 · 2017

Earlier work this paper cites.

A first look at deep learning apps on smartphones

Mengwei Xu, Jiawei Liu, Yuanqiang Liu, Felix Xiaozhu Lin, Yunxin Liu, and Xuanzhe Liu. 2019 · 2019

Earlier work this paper cites.

Edge intelligence: Paving the last mile of artificial intelligence with edge computing

Zhi Zhou, Xu Chen, En Li, Liekang Zeng, Ke Luo, and Junshan Zhang. 2019 · 2019

Earlier work this paper cites.

Attacking and protecting data privacy in edge–cloud collaborative inference systems

Zecheng He, Tianwei Zhang, and Ruby B Lee. 2020 · 2020

Earlier work this paper cites.

Smart at what cost? characterising mobile deep neural networks in the wild

Mario Almeida, Stefanos Laskaridis, Abhinav Mehrotra, Lukasz Dudziak, Ilias Leontiadis, and Nicholas D Lane. 2021 · 2021

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Cited alongside, same era.

{ \{ Zero-offload } \} : Democratizing { \{ billion-scale } \} model training

Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase, Shuangyan Yang, Minjia Zhang, Dong Li, and Yuxiong He. 2021 · 2021

Cited alongside, same era.

Gpt3. int8 (): 8-bit matrix multiplication for transformers at scale

Tim Dettmers, Mike Lewis, Younes Belkada, and Luke Zettlemoyer. 2022 · 2022

Cited alongside, same era.

Edge-cloud polarization and collaboration: A comprehensive survey for ai

Jiangchao Yao, Shengyu Zhang, Yang Yao, Feng Wang, Jianxin Ma, Jianwei Zhang, Yunfei Chu, Luo Ji, Kunyang Jia, Tao Shen, et al. 2022 · 2022

Cited alongside, same era.

A comprehensive survey of ai-generated content (aigc): A history of generative ai from gan to chatgpt

Original

Full parameter fine-tuning for large language models with limited resources

Original

Kai Lv, Yuqing Yang, Tengxiao Liu, Qinghui Gao, Qipeng Guo, and Xipeng Qiu. 2023 · 2023

Later among the works it cites.

Llm-pruner: On the structural pruning of large language models

Xinyin Ma, Gongfan Fang, and Xinchao Wang. 2023 · 2023

Later among the works it cites.

Lora-fa: Memory-efficient low-rank adaptation for large language models fine-tuning

Original

Longteng Zhang, Lin Zhang, Shaohuai Shi, Xiaowen Chu, and Bo Li. 2023 · 2023

Later among the works it cites.

Pockengine: Sparse and efficient fine-tuning in a pocket

Ligeng Zhu, Lanxiang Hu, Ji Lin, Wei-Ming Chen, Wei-Chen Wang, Chuang Gan, and Song Han. 2023 · 2023

Later among the works it cites.

Personal llm agents: Insights and survey about the capability, efficiency and security

Original

Yuanchun Li, Hao Wen, Weijun Wang, Xiangyu Li, Yizhen Yuan, Guohong Liu, Jiacheng Liu, Wenxing Xu, Xiang Wang, Yi Sun, Rui Kong, Yile Wang, Hanfei Geng, Jian Luan, Xuefeng Jin, Zilong Ye, Guanjing Xiong, Fan Zhang, Xiang Li, Mengwei Xu, Zhijun Li, Peng Li, Yang Liu, Ya-Qin Zhang, and Yunxin Liu. 2024 · 2024