Evaluation of the phi-3-mini SLM for identification of texts related to medicine, health, and sports injuries

Understand

Small Language Models (SLMs) have potential to be used for automatically labelling and identifying aspects of text data for medicine/health-related purposes from documents and the web.

• As their resource requirements are significantly lower than Large Language Models (LLMs), these can be deployed potentially on more types of devices.
• SLMs often are benchmarked on health/medicine-related tasks, such as MedQA, although performance on these can vary especially depending on the size of the model in terms of number of parameters.
• Furthermore, these test results may not necessarily reflect real-world performance regarding the automatic labelling or identification of texts in documents and the web.