Audio Visual Emotion Recognition with Temporal Alignment and Perception Attention

Understand

This paper focuses on two key problems for audio-visual emotion recognition in the video.

• One is the audio and visual streams temporal alignment for feature level fusion.
• The other one is locating and re-weighting the perception attentions in the whole audio-visual stream for better recognition.
• The Long Short Term Memory Recurrent Neural Network (LSTM-RNN) is employed as the main classification architecture.