Qwen2.5 Technical Report

Understand

In this report, we introduce Qwen2.5, a comprehensive series of large language models (LLMs) designed to meet diverse needs.

• Compared to previous iterations, Qwen 2.5 has been significantly improved during both the pre-training and post-training stages.
• In terms of pre-training, we have scaled the high-quality pre-training datasets from the previous 7 trillion tokens to 18 trillion tokens.
• This provides a strong foundation for common sense, expert knowledge, and reasoning capabilities.