Less is More: Optimizing Function Calling for LLM Execution on Edge Devices

D. Stamoulis, R. Ding, D. Wang, D. Lymberopoulos, B. Priyantha, J. Liu, and D. Marculescu, “Single-path nas: Designing hardware-efficient convnets in less than 4 hours,” in

2019

Earlier work this paper cites.

K. Song, X. Tan, T. Qin, J. Lu, and T.-Y. Liu, “Mpnet: Masked and permuted pre-training for language understanding,”

2020

Earlier work this paper cites.

L. S. Karumbunathan, “Nvidia jetson agx orin series,” 2022

2022

Earlier work this paper cites.

S. G. Patil, T. Zhang, X. Wang, and J. E. Gonzalez, “Gorilla: Large language model connected with massive apis,”

Original

2023

Earlier work this paper cites.

S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao, “ReAct: Synergizing reasoning and acting in language models,” in

2023

Earlier work this paper cites.

X. Ma, G. Fang, and X. Wang, “Llm-pruner: On the structural pruning of large language models,”

2023

Earlier work this paper cites.

W. Kwon, Z. Li, S. Zhuang, Y. Sheng, L. Zheng, C. H. Yu, J. Gonzalez, H. Zhang, and I. Stoica, “Efficient memory management for large language model serving with pagedattention,” in

2023

Earlier work this paper cites.

H. Jiang, Q. Wu, C.-Y. Lin, Y. Yang, and L. Qiu, “Llmlingua: Compressing prompts for accelerated inference of large language models,” in

2023

Earlier work this paper cites.

K. Alizadeh, I. Mirzadeh, D. Belenko, K. Khatamifard, M. Cho, C. C. Del Mundo, M. Rastegari, and M. Farajtabar, “Llm in a flash: Efficient large language model inference with limited memory,”

Original

2023

Earlier work this paper cites.

L. Chen, M. Zaharia, and J. Zou, “Frugalgpt: How to use large language models while reducing cost and improving performance,”

Original

2023

Earlier work this paper cites.

S. Kim, S. Moon, R. Tabrizi, N. Lee, M. W. Mahoney, K. Keutzer, and A. Gholami, “An llm compiler for parallel function calling,”

Original

2023

Earlier work this paper cites.

Y. Zhuang, Y. Yu, K. Wang, H. Sun, and C. Zhang, “Toolqa: A dataset for llm question answering with external tools,”

2023

Earlier work this paper cites.

A. Jiang

Original

2023

Earlier work this paper cites.

A. Karatzas and I. Anagnostopoulos, “Pythia: An edge first agent for state prediction in high-dimensional environments,”

2024

Earlier work this paper cites.

Z. Yuan, Y. Shang, Y. Zhou, Z. Dong, C. Xue, B. Wu, Z. Li, Q. Gu, Y. J. Lee, Y. Yan

Original

2024

Cited alongside, same era.

M. Abdin

Original

2024

Cited alongside, same era.

HuggingFace, “Function calling,”

2024

Cited alongside, same era.

Ollama, “Tool support,”

2024

Cited alongside, same era.

L. E. Erdogan, N. Lee, S. Jha, S. Kim, R. Tabrizi, S. Moon, C. Hooper, G. Anumanchipalli, K. Keutzer, and A. Gholami, “Tinyagent: Function calling at the edge,”

Original

2024

Cited alongside, same era.

F. Yan, H. Mao, C. C.-J. Ji, T. Zhang, S. G. Patil, I. Stoica, and J. E. Gonzalez, “Berkeley function calling leaderboard,”

J. Y. Koh, R. Lo, L. Jang, V. Duvvur, M. C. Lim, P.-Y. Huang, G. Neubig, S. Zhou, R. Salakhutdinov, and D. Fried, “Visualwebarena: Evaluating multimodal agents on realistic visual web tasks,”

2024

Closest in time.

S. Singh, M. Fore, A. Karatzas, C. Lee, Y. Jian, L. Shangguan, F. Yu, I. Anagnostopoulos, and D. Stamoulis, “Llm-dcache: Improving tool-augmented llms with gpt-driven localized data caching,”

Original

2024

Closest in time.

C. Hu, H. Huang, J. Hu, J. Xu, X. Chen, T. Xie, C. Wang, S. Wang, Y. Bao, N. Sun

Original

2024

Closest in time.

Y. Qin, S. Liang, Y. Ye, K. Zhu, L. Yan, Y. Lu, Y. Lin, X. Cong, X. Tang, B. Qian, S. Zhao, L. Hong, R. Tian, R. Xie, J. Zhou, M. Gerstein, dahai li, Z. Liu, and M. Sun, “ToolLLM: Facilitating large language models to master 16000+ real-world APIs,” in

2024

Closest in time.