Video Emotion Open-vocabulary Recognition Based on Multimodal Large Language Model

Understand

Multimodal emotion recognition is a task of great concern.

• However, traditional data sets are based on fixed labels, resulting in models that often focus on main emotions and ignore detailed emotional changes in complex scenes.
• This report introduces the solution of using MLLMs technology to generate open-vocabulary emotion labels from a video.
• The solution includes the use of framework, data generation and processing, training methods, results generation and multi-model co-judgment.