arXiv:2601.00812cs.CVcs.AI2026-01中稿 · publication in IEE…

用自由能原理分析广告视频情绪动态,仅凭画面特征就能解释愉悦、惊喜等反应。

Free Energy-Based Modeling of Emotional Dynamics in Video Advertisements

  • 基于自由能原理,用画面特征计算预测误差、信念更新和先验模糊度。
  • 在1059条美食广告中验证了三类情绪模式,且结果在多种参数下稳定。
  • 适合做可解释的广告情绪分析,尤其对无生理数据场景有实用价值。

观看广告时的情绪反应对理解媒体效果至关重要,影响注意力、记忆与购买意愿。为建立无需依赖生理信号或主观评分的可解释情绪估计方法,本文仅通过广告视频的场景级表达特征,运用自由能(Free Energy, FE)原理量化“愉悦感”、“意外感”与“习惯化”。在该框架中,Kullback-Leibler散度(KLD)表征预测误差,贝叶斯意外(Bayesian Surprise, BS)反映信念更新,不确定性(Uncertainty, UN)体现先验模糊性,三者构成FE核心。基于1059条15秒食品广告实验发现:KLD对应品牌呈现带来的“愉悦感”,BS捕捉由信息复杂性引发的“意外感”,而UN则反映元素类型、空间布局的不确定性及元素数量与变化的多样性所导致的“意外感”。研究识别出三种典型情绪模式:不确定刺激、持续高情绪、瞬时峰值后衰减。在九组超参数设置及六类日本广告视频(三类题材、两段时长)的泛化测试中,这些趋势保持稳定。未来可通过扩展表达元素并结合主观评分验证,推动更具吸引力广告内容生成技术的发展。

原文摘要 · Abstract (English)

Emotional responses during advertising video viewing are recognized as essential for understanding media effects because they have influenced attention, memory, and purchase intention. To establish a methodological basis for explainable emotion estimation without relying on external information such as physiological signals or subjective ratings, we have quantified "pleasantness," "surprise," and "habituation" solely from scene-level expression features of advertising videos, drawing on the free energy(FE) principle, which has provided a unified account of perception, learning, and behavior. In this framework, Kullback-Leibler divergence (KLD) has captured prediction error, Bayesian surprise (BS) has captured belief updates, and uncertainty (UN) has reflected prior ambiguity, and together they have formed the core components of FE. Using 1,059 15 s food video advertisements, the experiments have shown that KLD has reflected "pleasantness" associated with brand presentation, BS has captured "surprise" arising from informational complexity, and UN has reflected "surprise" driven by uncertainty in element types and spatial arrangements, as well as by the variability and quantity of presented elements. This study also identified three characteristic emotional patterns, namely uncertain stimulus, sustained high emotion, and momentary peak and decay, demonstrating the usefulness of the proposed method. Robustness across nine hyperparameter settings and generalization tests with six types of Japanese advertising videos (three genres and two durations) confirmed that these tendencies remained stable. This work can be extended by integrating a wider range of expression elements and validating the approach through subjective ratings, ultimately guiding the development of technologies that can support the creation of more engaging advertising videos.

情绪建模自由能原理广告分析视频理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。