DisasterQA: A Benchmark for Assessing the performance of LLMs in Disaster Response

Understand

Disasters can result in the deaths of many, making quick response times vital.

• Large Language Models (LLMs) have emerged as valuable in the field.
• LLMs can be used to process vast amounts of textual information quickly providing situational context during a disaster.
• However, the question remains whether LLMs should be used for advice and decision making in a disaster.