FedMABench: Benchmarking Mobile Agents on Decentralized Heterogeneous User Data

MiniVLM: A Smaller and Faster Vision-Language Model

Original

Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, and Zicheng Liu. 2021 · 2012

Earlier work this paper cites.

Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics . PMLR, 1273–1282

Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017 · 2017

Earlier work this paper cites.

Measuring the effects of non-identical data distribution for federated visual classification

Original

Tzu-Ming Harry Hsu, Hang Qi, and Matthew Brown. 2019 · 2019

Earlier work this paper cites.

Scaffold: Stochastic controlled averaging for federated learning. In International Conference on Machine Learning . PMLR, 5132–5143

Sai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank Reddi, Sebastian Stich, and Ananda Theertha Suresh. 2020 · 2020

Earlier work this paper cites.

Federated optimization in heterogeneous networks

Tian Li, Anit Kumar Sahu, Manzil Zaheer, Maziar Sanjabi, Ameet Talwalkar, and Virginia Smith. 2020 · 2020

Earlier work this paper cites.

Adaptive Federated Optimization. In International Conference on Learning Representations

Sashank J Reddi, Zachary Charles, Manzil Zaheer, Zachary Garrett, Keith Rush, Jakub Konečnỳ, Sanjiv Kumar, and Hugh Brendan McMahan. 2020 · 2020

Earlier work this paper cites.

LoRA: Low-Rank Adaptation of Large Language Models. In ICLR

Edward J Hu, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al · 2021

Earlier work this paper cites.

A good prompt is worth millions of parameters: Low-resource prompt-based learning for vision-language models

Original

Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, and Xiang Ren. 2021 · 2021

Earlier work this paper cites.

TEA-fed: time-efficient asynchronous federated learning for edge computing. In Proceedings of the 18th ACM international conference on computing frontiers . 30–37

Chendi Zhou, Hao Tian, Hong Zhang, Jin Zhang, Mianxiong Dong, and Juncheng Jia. 2021 · 2021

Earlier work this paper cites.

Rethinking architecture design for tackling data heterogeneity in federated learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition . 10061–10071

Liangqiong Qu, Yuyin Zhou, Paul Pu Liang, Yingda Xia, Feifei Wang, Ehsan Adeli, Li Fei-Fei, and Daniel Rubin. 2022 · 2022

Earlier work this paper cites.

Learning to prompt for vision-language models

Kaiyang Zhou, Jingkang Yang, Chen Change Loy, and Ziwei Liu. 2022 · 2022

Earlier work this paper cites.

CogAgent: A Visual Language Model for GUI Agents

Original

Wenyi Hong, Weihan Wang, Qingsong Lv, Jiazheng Xu, Wenmeng Yu, Junhui Ji, Yan Wang, Zihan Wang, Yuxuan Zhang, Juanzi Li, Bin Xu, Yuxiao Dong, Ming Ding, and Jie Tang. 2023 · 2023

Earlier work this paper cites.

FederatedScope-LLM: A comprehensive package for fine-tuning large language models in federated learning

Original

Weirui Kuang, Bingchen Qian, Zitao Li, Daoyuan Chen, Dawei Gao, Xuchen Pan, Yuexiang Xie, Yaliang Li, Bolin Ding, and Jingren Zhou. 2023 · 2023

Earlier work this paper cites.

GPT-4: A Large-Scale Multimodal Model

Original

OpenAI. 2023 · 2023

Earlier work this paper cites.

Android in the Wild: A Large-Scale Dataset for Android Device Control

Original

Christopher Rawles, Alice Li, Daniel Rodriguez, Oriana Riva, and Timothy Lillicrap. 2023 · 2023

Earlier work this paper cites.

Heterogeneous federated learning: State-of-the-art and research challenges

Mang Ye, Xiuwen Fang, Bo Du, Pong C Yuen, and Dacheng Tao. 2023 · 2023

Earlier work this paper cites.

DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning

Original

Hao Bai, Yifei Zhou, Mert Cemri, Jiayi Pan, Alane Suhr, Sergey Levine, and Aviral Kumar. 2024 · 2024

Cited alongside, same era.

The Phantom Menace: Unmasking Privacy Leakages in Vision-Language Models

Original

Simone Caldarella, Massimiliano Mancini, Elisa Ricci, and Rahaf Aljundi. 2024 · 2024

Cited alongside, same era.

Octopus v2: On-device language model for super agent

Original

Wei Chen and Zhiyuan Li. 2024 · 2024

Cited alongside, same era.

Internvl: Scaling up vision foundation models and aligning for generic visual-linguistic tasks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 24185–24198

Zhe Chen, Jiannan Wu, Wenhai Wang, Weijie Su, Guo Chen, Sen Xing, Muyan Zhong, Qinglong Zhang, Xizhou Zhu, Lewei Lu, et al · 2024

Cited alongside, same era.

Privacy-Aware Visual Language Models

Original

Laurens Samson, Nimrod Barazani, Sennay Ghebreab, and Yuki M. Asano. 2024 · 2024

Later among the works it cites.

OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis

Original

Qiushi Sun, Kanzhi Cheng, Zichen Ding, Chuanyang Jin, Yian Wang, Fangzhi Xu, Zhenyu Wu, Chengyou Jia, Liheng Chen, Zhoumianze Liu, Ben Kao, Guohao Li, Junxian He, Yu Qiao, and Zhiyong Wu. 2024 · 2024

Later among the works it cites.

Qwen2-VL: Enhancing Vision-Language Model’s Perception of the World at Any Resolution

Original

Peng Wang, Shuai Bai, Sinan Tan, Shijie Wang, Zhihao Fan, Jinze Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Yang Fan, Kai Dang, Mengfei Du, Xuancheng Ren, Rui Men, Dayiheng Liu, Chang Zhou, Jingren Zhou, and Junyang Lin. 2024a · 2024

Later among the works it cites.

KnowledgeSG: Privacy-Preserving Synthetic Text Generation with Knowledge Distillation from Server. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , Yaser Al-Onaizan, Mohit Bansal, and Yun-Nung Chen (Eds.). Association for Computational Linguistics, Miami, Florida, USA, 7677–7695