Salamandra Technical Report

Understand

This work introduces Salamandra, a suite of open-source decoder-only large language models available in three different sizes: 2, 7, and 40 billion parameters.

• The models were trained from scratch on highly multilingual data that comprises text in 35 European languages and code.
• Our carefully curated corpus is made exclusively from open-access data compiled from a wide variety of sources.
• Along with the base models, supplementary checkpoints that were fine-tuned on public-domain instruction data are also released for chat applications.