P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs

Understand

Recent advancements in large language models (LLMs) showcase varied multilingual capabilities across tasks like translation, code generation, and reasoning.

• Previous assessments often limited their scope to fundamental natural language processing (NLP) or isolated capability-specific tasks.
• To alleviate this drawback, we aim to present a comprehensive multilingual multitask benchmark.
• First, we introduce P-MMEval, a large-scale benchmark covering effective fundamental and capability-specialized datasets.