xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

Understand

With the release of OpenAI's o1 model, reasoning models that adopt slow-thinking strategies have become increasingly common.

• Their outputs often contain complex reasoning, intermediate steps, and self-reflection, making existing evaluation methods and reward models inadequate.
• In particular, they struggle to judge answer equivalence and to reliably extract final answers from long, complex responses.
• To address this challenge, we propose xVerify, an efficient answer verifier for evaluating reasoning models.