Benchmarking AI scientists for omics data driven biological discovery

Understand

Recent advances in large language models have enabled the emergence of AI scientists that aim to autonomously analyze biological data and assist scientific discovery.

• Despite rapid progress, it remains unclear to what extent these systems can extract meaningful biological insights from real experimental data.
• Existing benchmarks either evaluate reasoning in the absence of data or focus on predefined analytical outputs, failing to reflect realistic, data-driven biological research.
• Here, we introduce BAISBench (Biological AI Scientist Benchmark), a benchmark for evaluating AI scientists on real single-cell transcriptomic datasets.