A Multi-modal and Multi-task Learning Method for Action Unit and Expression Recognition

Understand

Analyzing human affect is vital for human-computer interaction systems.

• Most methods are developed in restricted scenarios which are not practical for in-the-wild settings.
• The Affective Behavior Analysis in-the-wild (ABAW) 2021 Contest provides a benchmark for this in-the-wild problem.
• In this paper, we introduce a multi-modal and multi-task learning method by using both visual and audio information.