Arabic Stable LM: Adapting Stable LM 2 1.6B to Arabic

Understand

Large Language Models (LLMs) have shown impressive results in multiple domains of natural language processing (NLP) but are mainly focused on the English language.

• Recently, more LLMs have incorporated a larger proportion of multilingual text to represent low-resource languages.
• In Arabic NLP, several Arabic-centric LLMs have shown remarkable results on multiple benchmarks in the past two years.
• However, most Arabic LLMs have more than 7 billion parameters, which increases their hardware requirements and inference latency, when compared to smaller LLMs.