StimuVAR: Spatiotemporal Stimuli-aware Video Affective Reasoning with Multimodal Large Language Models

Understand

Predicting and reasoning how a video would make a human feel is crucial for developing socially intelligent systems.

• Although Multimodal Large Language Models (MLLMs) have shown impressive video understanding capabilities, they tend to focus more on the semantic content of videos, often overlooking emotional stimuli.
• Hence, most existing MLLMs fall short in estimating viewers' emotional reactions and providing plausible explanations.
• To address this issue, we propose StimuVAR, a spatiotemporal Stimuli-aware framework for Video Affective Reasoning (VAR) with MLLMs.