LEGOBench: Scientific Leaderboard Generation Benchmark

Understand

The ever-increasing volume of paper submissions makes it difficult to stay informed about the latest state-of-the-art research.

• To address this challenge, we introduce LEGOBench, a benchmark for evaluating systems that generate scientific leaderboards.
• LEGOBench is curated from 22 years of preprint submission data on arXiv and more than 11k machine learning leaderboards on the PapersWithCode portal.
• We present four graph-based and two language model-based leaderboard generation task configurations.