FinanceBench: A New Benchmark for Financial Question Answering

Understand

FinanceBench is a first-of-its-kind test suite for evaluating the performance of LLMs on open book financial question answering (QA).

• It comprises 10,231 questions about publicly traded companies, with corresponding answers and evidence strings.
• The questions in FinanceBench are ecologically valid and cover a diverse set of scenarios.
• They are intended to be clear-cut and straightforward to answer to serve as a minimum performance standard.