Why Not Transform Chat Large Language Models to Non-English?

Understand

The scarcity of non-English data limits the development of non-English large language models (LLMs).

• Transforming English-centric LLMs to non-English has been identified as an effective and resource-efficient method.
• Previous works start from base LLMs and perform knowledge distillation (KD) with data generated by stronger LLMs, e.g.
• GPT-4.