Fetching the paper…
Reading the bibliography…
Large Language Models (LLM) and foundation models are popular as they offer new opportunities for individuals and businesses to improve natural language processing, interact with data, and retrieve information faster.
Advanced Computer Architecture: Parallelism,Scalability,Programmability
Kai Hwang · 1992
Earlier work this paper cites.
ROUGE: A package for automatic evaluation of summaries
Chin-Yew Lin · 2004
Earlier work this paper cites.
Flower: A friendly federated learning research framework, 2020
Daniel J. Beutel, Taner Topal, Akhil Mathur, Xinchi Qiu, Javier Fernandez-Marques, Yan Gao, Lorenzo Sani, Kwing Hei Li, Titouan Parcollet, Pedro Porto Buarque de Gusmão, and Nicholas D. Lane · 2007
Earlier work this paper cites.
Fedml: A research library and benchmark for federated machine learning, 2020
Chaoyang He, Songze Li, et al · 2007
Earlier work this paper cites.
4g (lte advanced)
3GPP · 2008
Earlier work this paper cites.
Energy consumption of content distribution from nano data centers versus centralized data centers
Fatemeh Jalali, Rob Ayre, Arun Vishwanath, Kerry Hinton, Tansu Alpcan, and Rod Tucker · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
Communication-Efficient Learning of Deep Networks from Decentralized Data
Brendan McMahan, Eider Moore, et al · 2017
Earlier work this paper cites.
Leaf: A benchmark for federated settings
Sebastian Caldas, Peter Wu, Tian Li, Jakub Konecný, H. Brendan McMahan, Virginia Smith, and Ameet Talwalkar · 2018
Earlier work this paper cites.
MODI: Mobile deep inference made efficient by edge computing
Samuel S. Ogden and Tian Guo · 2018
Earlier work this paper cites.
SAMSum corpus: A human-annotated dialogue dataset for abstractive summarization
Bogdan Gliwa, Iwona Mochol, Maciej Biesek, and Aleksander Wawer · 2019
Earlier work this paper cites.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2019
Earlier work this paper cites.
In-edge ai: Intelligentizing mobile edge computing, caching and communication by federated learning
Xiaofei Wang, Yiwen Han, Chenyang Wang, Qiyang Zhao, Xu Chen, and Min Chen · 2019
Earlier work this paper cites.
Accelerating federated learning via momentum gradient descent
Wei Liu, Li Chen, et al · 2020
Earlier work this paper cites.
Errant: Realistic emulation of radio access networks
Martino Trevisan, Ali Safari Khatouni, and Danilo Giordano · 2020
Earlier work this paper cites.
Edgefed: Optimized federated learning based on edge computing
Yunfan Ye, Shen Li, Fang Liu, Yonghao Tang, and Wanting Hu · 2020
Earlier work this paper cites.
Exdra: Exploratory data science on federated raw data
Sebastian Baunsgaard, Matthias Boehm, and et al · 2021
Earlier work this paper cites.
On the opportunities and risks of foundation models
Rishi Bommasani, Drew A. Hudson, et al · 2021
Cited alongside, same era.
Proposal for a REGULATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL - LAYING DOWN HARMONISED RULES ON ARTIFICIAL INTELLIGENCE (ARTIFICIAL INTELLIGENCE ACT) AND AMENDING CERTAIN UNION LEGISLATIVE ACTS, apr 2021
Council of the European Union · 2021
Cited alongside, same era.
Min-max cost optimization for efficient hierarchical federated learning in wireless edge networks
Jie Feng, Lei Liu, Qingqi Pei, and Keqin Li · 2021
Cited alongside, same era.
Data movement is all you need: A case study on optimizing transformers
Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Shigang Li, and Torsten Hoefler · 2021
Cited alongside, same era.
Adaptive federated optimization
Sashank J. Reddi, Zachary Charles, et al · 2021
Cited alongside, same era.
FedScale: Benchmarking model and system performance of federated learning at scale
Fan Lai, Yinwei Dai, Sanjay S. Singapuram, Jiachen Liu, Xiangfeng Zhu, Harsha V. Madhyastha, and Mosharaf Chowdhury · 2022
Later among the works it cites.
FedBERT: When federated learning meets pre-training
Yuanyishu Tian, Yao Wan, Lingjuan Lyu, Dezhong Yao, Hai Jin, and Lichao Sun · 2022
Later among the works it cites.
Amazon AWS p3 instance types
Amazon Web Services (AWS) · 2023
Closest in time.
SLoRA: Federated parameter efficient fine-tuning of language models
Sara Babakniya, Ahmed Elkordy, et al · 2023
Closest in time.
Trends in ai inference energy consumption: Beyond the performance-vs-parameter laws of deep learning
Radosvet Desislavov, Fernando Martínez-Plumed, and José Hernández-Orallo · 2023
Closest in time.
Fate-llm: A industrial grade federated learning framework for large language models, 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Jie Ren, Samyam Rajbhandari, et al · 2021
Cited alongside, same era.
On the design of federated learning in latency and energy constrained computation offloading operations in vehicular edge computing systems
Swapnil Sadashiv Shinde, Arash Bozorgchenani, Daniele Tarchi, and Qiang Ni · 2021
Cited alongside, same era.
A survey on edge performance benchmarking
Blesson Varghese, Nan Wang, David Bermbach, Cheol-Ho Hong, Eyal De Lara, Weisong Shi, and Christopher Stewart · 2021
Cited alongside, same era.
Toward resource-efficient federated learning in mobile edge computing
Rong Yu and Peichun Li · 2021
Cited alongside, same era.
Federated learning for energy-balanced client selection in mobile edge computing
Jingjing Zheng, Kai Li, Eduardo Tovar, and Mohsen Guizani · 2021
Cited alongside, same era.
Scaling instruction-finetuned language models
Hyung Won Chung, Le Hou, et al · 2022
Cited alongside, same era.
Benchmarking resource usage for efficient distributed deep learning
Nathan C. Frey, Baolin Li, Joseph McDonald, Dan Zhao, Michael Jones, David Bestor, Devesh Tiwari, Vijay Gadepally, and Siddharth Samsi · 2022
Cited alongside, same era.
Tao Fan, Yan Kang, Guoqiang Ma, Weijing Chen, Wenbin Wei, Lixin Fan, and Qiang Yang · 2023
Closest in time.
Federated learning with regularized client participation
Grigory Malinovsky, Samuel Horváth, Konstantin Pavlovich Burlachenko, and Peter Richtárik · 2023
Closest in time.
Zhen Qin, Daoyuan Chen, et al · 2023
Closest in time.
Fwdllm: Efficient fedllm using forward gradient, 2023
Mengwei Xu, Dongqi Cai, Yaozong Wu, Xiang Li, and Shangguang Wang · 2023
Closest in time.
Green federated learning, 2023
Ashkan Yousefpour, Shen Guo, Ashish Shenoy, Sayan Ghosh, Pierre Stock, Kiwan Maeng, Schalk-Willem Krüger, Michael Rabbat, Carole-Jean Wu, and Ilya Mironov · 2023
Closest in time.
Towards building the federatedGPT: Federated instruction tuning
Jianyi Zhang, Saeed Vahidian, Martin Kuo, Chunyuan Li, Ruiyi Zhang, Tong Yu, Guoyin Wang, and Yiran Chen · 2023
Closest in time.
FedPETuning: When federated learning meets the parameter-efficient tuning methods of pre-trained language models
Zhuo Zhang, Yuanhang Yang, Yong Dai, Qifan Wang, Yue Yu, Lizhen Qu, and Zenglin Xu · 2023
Closest in time.
Pytorch fsdp: Experiences on scaling fully sharded data parallel
Yanli Zhao, Andrew Gu, et al · 2023
Closest in time.
Palm: scaling language modeling with pathways
Aakanksha Chowdhery, Sharan Narang, et al · 2024
Closest in time.
Xue-Yong Fu, Md Tahmid Rahman Laskar, et al · 2024
Closest in time.
The era of 1-bit llms: All large language models are in 1.58 bits, 2024
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, and Furu Wei · 2024
Closest in time.
Federated learning priorities under the european union artificial intelligence act, 2024
Herbert Woisetschläger, Alexander Erben, Bill Marino, Shiqiang Wang, Nicholas D. Lane, Ruben Mayer, and Hans-Arno Jacobsen · 2024
Closest in time.