Large Language Models in the Clinic: A Comprehensive Benchmark

Understand

The adoption of large language models (LLMs) to assist clinicians has attracted remarkable attention.

• Existing works mainly adopt the close-ended question-answering (QA) task with answer options for evaluation.
• However, many clinical decisions involve answering open-ended questions without pre-set options.
• To better understand LLMs in the clinic, we construct a benchmark ClinicBench.