arXiv:2507.12889cs.CV2025-07

用摄像头捕捉眼神与环境互动,无感识别深层情绪

Camera-based implicit mind reading by capturing higher-order semantic dynamics of human gaze within environmental context

  • 通过眼神轨迹与环境语义动态建模,挖掘隐性情绪
  • 无需特殊设备,在自然场景中实现实时连续情绪识别
  • 适合智能交互、人因研究等无感监测场景

情绪识别是迈向心读的重要一步,旨在从外部线索推断内在状态。现有方法多依赖面部表情、语音或手势等显性信号,仅反映身体反应,忽略环境上下文影响,且易被伪装。生理信号方法虽更直接,但需复杂传感器,破坏自然行为并限制可扩展性。眼神分析通常基于静态凝视点,无法捕捉眼神与环境的丰富动态交互,难以揭示情绪与隐性行为的深层关联。为此,本文提出一种新型摄像头驱动的无感知情绪识别方法,融合凝视模式与环境语义及时间动态。利用标准高清摄像头,在自然环境中无感捕捉眼动与头部运动,无需专用硬件或主动参与。系统据此估计时空维度的眼动轨迹,建模视觉注意与周围环境的动态互动,揭示情绪是人-环境交互的复杂产物。该方法实现无感、实时、持续的情绪识别,具有高泛化能力与低部署成本。

原文摘要 · Abstract (English)

Emotion recognition,as a step toward mind reading,seeks to infer internal states from external cues.Most existing methods rely on explicit signals-such as facial expressions,speech,or gestures-that reflect only bodily responses and overlook the influence of environmental context.These cues are often voluntary,easy to mask,and insufficient for capturing deeper,implicit emotions. Physiological signal-based approaches offer more direct access to internal states but require complex sensors that compromise natural behavior and limit scalability.Gaze-based methods typically rely on static fixation analysis and fail to capture the rich,dynamic interactions between gaze and the environment,and thus cannot uncover the deep connection between emotion and implicit behavior.To address these limitations,we propose a novel camera-based,user-unaware emotion recognition approach that integrates gaze fixation patterns with environmental semantics and temporal dynamics.Leveraging standard HD cameras,our method unobtrusively captures users'eye appearance and head movements in natural settings-without the need for specialized hardware or active user participation.From these visual cues,the system estimates gaze trajectories over time and space, providing the basis for modeling the spatial, semantic,and temporal dimensions of gaze behavior. This allows us to capture the dynamic interplay between visual attention and the surrounding environment,revealing that emotions are not merely physiological responses but complex outcomes of human-environment interactions.The proposed approach enables user-unaware,real-time,and continuous emotion recognition,offering high generalizability and low deployment cost.

情绪识别眼神追踪无感监测环境上下文

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。