Multi-task Regularization Based on Infrequent Classes for Audio Captioning

Understand

Audio captioning is a multi-modal task, focusing on using natural language for describing the contents of general audio.

• Most audio captioning methods are based on deep neural networks, employing an encoder-decoder scheme and a dataset with audio clips and corresponding natural language descriptions (i.e.
• captions).
• A significant challenge for audio captioning is the distribution of words in the captions: some words are very frequent but acoustically non-informative, i.e.