Multimodal Continuous Emotion Recognition: A Technical Report for ABAW5

Understand

We used two multimodal models for continuous valence-arousal recognition using visual, audio, and linguistic information.

• The first model is the same as we used in ABAW2 and ABAW3, which employs the leader-follower attention.
• The second model has the same architecture for spatial and temporal encoding.
• As for the fusion block, it employs a compact and straightforward channel attention, borrowed from the End2You toolkit.