SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Tasks

Understand

We present SciArena, an open and collaborative platform for evaluating foundation models on scientific literature-grounded tasks.

• Unlike traditional benchmarks for scientific literature understanding and synthesis, SciArena engages the research community directly, following the Chatbot Arena evaluation approach of community voting on model comparisons.
• By leveraging collective intelligence, SciArena offers a community-driven evaluation of model performance on open-ended scientific tasks that demand literature-grounded, long-form responses.
• The platform currently supports 47 foundation models and has collected over 20,000 votes from human researchers across diverse scientific domains.