Facial Affect Recognition based on Transformer Encoder and Audiovisual Fusion for the ABAW5 Challenge

Understand

In this paper, we present our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes four sub-challenges of Valence-Arousal (VA) Estimation, Expression (Expr) Classification, Action Unit (AU) Detection and Emotional Reaction Intensity (ERI) Estimation.

• The 5th ABAW competition focuses on facial affect recognition utilizing different modalities and datasets.
• In our work, we extract powerful audio and visual features using a large number of sota models.
• These features are fused by Transformer Encoder and TEMMA.