LLM Collaboration With Multi-Agent Reinforcement Learning

Understand

A large amount of work has been done in Multi-Agent Systems (MAS) for modeling and solving problems with multiple interacting agents.

• However, most LLMs are pretrained independently and not specifically optimized for coordination.
• Existing LLM fine-tuning frameworks rely on individual rewards, which require complex reward designs for each agent to encourage collaboration.
• To address these challenges, we model LLM collaboration as a cooperative Multi-Agent Reinforcement Learning (MARL) problem.