Large Language Models Leverage External Knowledge to Extend Clinical Insight Beyond Language Boundaries

Understand

$\textbf{Objectives}$: Large Language Models (LLMs) such as ChatGPT and Med-PaLM have excelled in various medical question-answering tasks.

• However, these English-centric models encounter challenges in non-English clinical settings, primarily due to limited clinical knowledge in respective languages, a consequence of imbalanced training corpora.
• We systematically evaluate LLMs in the Chinese medical context and develop a novel in-context learning framework to enhance their performance.
• $\textbf{Materials and Methods}$: The latest China National Medical Licensing Examination (CNMLE-2022) served as the benchmark.