CLUE: A Chinese Language Understanding Evaluation Benchmark

Understand

The advent of natural language understanding (NLU) benchmarks for English, such as GLUE and SuperGLUE allows new NLU models to be evaluated across a diverse set of tasks.

• These comprehensive benchmarks have facilitated a broad range of research and applications in natural language processing (NLP).
• The problem, however, is that most such benchmarks are limited to English, which has made it difficult to replicate many of the successes in English NLU for other languages.
• To help remedy this issue, we introduce the first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark.