Toward Scalable Generative AI via Mixture of Experts in Mobile Edge Networks

Understand

The advancement of generative artificial intelligence (GAI) has driven revolutionary applications like ChatGPT.

• The widespread of these applications relies on the mixture of experts (MoE), which contains multiple experts and selectively engages them for each task to lower operation costs while maintaining performance.
• Despite MoE, GAI faces challenges in resource consumption when deployed on user devices.
• This paper proposes mobile edge networks supported MoE-based GAI.