DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignment

Understand

We introduce DeSTA2.5-Audio, a general-purpose Large Audio Language Model (LALM) designed for robust auditory perception and instruction-following.

• Recent LALMs augment Large Language Models (LLMs) with auditory capabilities by training on large-scale audio-instruction datasets.
• However, existing LALMs have often suffered from the catastrophic forgetting of the LLM's original abilities.
• Therefore, balancing knowledge retention and audio perception has become a critical challenge.