Audio Captioning using Gated Recurrent Units

Understand

Audio captioning is a recently proposed task for automatically generating a textual description of a given audio clip.

• In this study, a novel deep network architecture with audio embeddings is presented to predict audio captions.
• Within the aim of extracting audio features in addition to log Mel energies, VGGish audio embedding model is used to explore the usability of audio embeddings in the audio captioning task.
• The proposed architecture encodes audio and text input modalities separately and combines them before the decoding stage.