WritingBench: A Comprehensive Benchmark for Generative Writing

Understand

Recent advancements in large language models (LLMs) have significantly enhanced text generation capabilities, yet evaluating their performance in generative writing remains a challenge.

• Existing benchmarks primarily focus on generic text generation or limited in writing tasks, failing to capture the diverse requirements of high-quality written contents across various domains.
• To bridge this gap, we present WritingBench, a comprehensive benchmark designed to evaluate LLMs across 6 core writing domains and 100 subdomains.
• We further propose a query-dependent evaluation framework that empowers LLMs to dynamically generate instance-specific assessment criteria.