arXiv:2504.06237cs.CV2025-04被引 1

通过面部与视线分析,实时检测在线广告观看时的分心行为。

Monitoring Viewer Attention During Online Ads

  • 结合面部表情、头部姿态和视线方向,提取高阶注意力特征。
  • 在真实广告测试数据上,对四种分心类型检测准确率达89.3%。
  • 适配桌面与移动端,适合品牌方优化广告效果评估流程。

如今,视频广告通过众多在线平台传播,全球数百万观众在线观看。大品牌常通过招募用户在家或工作场所观看广告,并分析其面部反应来评估广告吸引力与购买意愿。尽管该方法能捕捉自然反应,但参与者所处环境中的干扰(如电视播放、同事交谈、手机通知)会影响结果准确性。为避免无效数据,需识别并剔除注意力不集中的参与者。本文提出一种在线广告观看过程中的注意力监测架构,利用AFFDEX 2.0与SmartEye SDK两个行为分析工具包,提取面部表情、头部姿态及视线方向等低层特征,并融合生成高阶特征,包括屏幕平面注视点、打哈欠、说话等,从而识别四类主要分心行为:视线偏离屏幕、困倦、说话与未关注屏幕。该架构根据设备类型(桌面或移动)动态调整注视参数。我们在标注了特定分心类型的多个数据集上验证了该架构,并进一步在包含多种分心的真实广告测试数据集上进行测试。实验表明,该架构在桌面与移动端均表现出良好的分心检测能力。

原文摘要 · Abstract (English)

Nowadays, video ads spread through numerous online platforms, and are being watched by millions of viewers worldwide. Big brands gauge the liking and purchase intent of their new ads, by analyzing the facial responses of viewers recruited online to watch the ads from home or work. Although this approach captures naturalistic responses, it is susceptible to distractions inherent in the participants' environments, such as a movie playing on TV, a colleague speaking, or mobile notifications. Inattentive participants should get flagged and eliminated to avoid skewing the ad-testing process. In this paper we introduce an architecture for monitoring viewer attention during online ads. Leveraging two behavior analysis toolkits; AFFDEX 2.0 and SmartEye SDK, we extract low-level facial features encompassing facial expressions, head pose, and gaze direction. These features are then combined to extract high-level features that include estimated gaze on the screen plane, yawning, speaking, etc -- this enables the identification of four primary distractors; off-screen gaze, drowsiness, speaking, and unattended screen. Our architecture tailors the gaze settings according to the device type (desktop or mobile). We validate our architecture first on datasets annotated for specific distractors, and then on a real-world ad testing dataset with various distractors. The proposed architecture shows promising results in detecting distraction across both desktop and mobile devices.

注意力检测广告评估多模态分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。