arXiv:2505.19178cs.CVcs.AI2025-05中稿 · publication at IBP…

用视觉显著性预测观众情绪,揭示多显著区域引发愉悦低激活情绪

Saliency-guided Emotion Modeling: Predicting Viewer Reactions from Video Stimuli

  • 基于视频显著区域数量和分布预测情绪
  • 多显著区域视频引发高愉悦低唤醒情绪,单显著区域则相反
  • 适合内容创作与情感计算研究者参考

理解视频的情感影响对内容创作、广告和人机交互至关重要。传统情感计算依赖自我报告、面部表情分析和生物传感数据,但常忽略视觉显著性——视频中自然吸引注意力的区域。本研究利用深度学习,提出一种基于显著性的新情绪预测方法,提取显著区域面积和数量两个关键特征。结合HD2S显著性模型与OpenFace面部动作单元分析,探讨视频显著性与观众情绪的关系。研究发现:(1) 多个显著区域的视频更易引发高愉悦、低唤醒情绪;(2) 单一主导显著区域的视频更可能引发低愉悦、高唤醒反应;(3) 自我报告情绪常与基于面部表情的情绪检测不一致,提示主观报告存在局限。该方法提供了一种计算高效且可解释的情绪建模方案,对内容创作、个性化媒体体验及情感计算研究具有重要意义。

原文摘要 · Abstract (English)

Understanding the emotional impact of videos is crucial for applications in content creation, advertising, and Human-Computer Interaction (HCI). Traditional affective computing methods rely on self-reported emotions, facial expression analysis, and biosensing data, yet they often overlook the role of visual saliency -- the naturally attention-grabbing regions within a video. In this study, we utilize deep learning to introduce a novel saliency-based approach to emotion prediction by extracting two key features: saliency area and number of salient regions. Using the HD2S saliency model and OpenFace facial action unit analysis, we examine the relationship between video saliency and viewer emotions. Our findings reveal three key insights: (1) Videos with multiple salient regions tend to elicit high-valence, low-arousal emotions, (2) Videos with a single dominant salient region are more likely to induce low-valence, high-arousal responses, and (3) Self-reported emotions often misalign with facial expression-based emotion detection, suggesting limitations in subjective reporting. By leveraging saliency-driven insights, this work provides a computationally efficient and interpretable alternative for emotion modeling, with implications for content creation, personalized media experiences, and affective computing research.

情绪预测视觉显著性视频分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。