EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Records

Understand

We present a new text-to-SQL dataset for electronic health records (EHRs).

• The utterances were collected from 222 hospital staff members, including physicians, nurses, and insurance review and health records teams.
• To construct the QA dataset on structured EHR data, we conducted a poll at a university hospital and used the responses to create seed questions.
• We then manually linked these questions to two open-source EHR databases, MIMIC-III and eICU, and included various time expressions and held-out unanswerable questions in the dataset, which were also collected from the poll.