arXiv:2506.12524cs.CVcs.HC2025-06IJCAI被引 2

用后处理提升眼动追踪精度,让微表情识别更准

Inference-Time Gaze Refinement for Micro-Expression Recognition: Enhancing Event-Based Eye Tracking with Motion-Aware Post-Processing

  • 引入运动感知滤波与光流修正,优化事件相机眼动输出
  • 在多个基线模型上提升轨迹平滑度,减少抖动和跳跃
  • 适合做微表情、注意力分析等需要高时序精度的任务

事件相机眼动追踪在细粒度认知状态推断中具有巨大潜力,具备高时间分辨率和抗运动伪影能力,对识别注意力、困惑或疲劳等细微心理状态至关重要。本文提出一种无需修改模型架构或重新训练的推理阶段精炼框架,包含两个关键后处理模块:(i) 运动感知中值滤波,可抑制眨眼引起的信号突变,同时保留自然眼动动态;(ii) 基于光流的局部修正,将眼动预测与累积事件运动对齐,降低空间抖动和时间不连续性。为补充传统空间精度指标,我们提出一种新型抖动度量(Jitter Metric),基于速度规律性和局部信号复杂性捕捉预测轨迹的时序平滑性。实验表明,该方法在多个基线模型上均实现一致性能提升,显著增强事件眼动信号的一致性,使其更适用于微表情分析与心智状态解码等下游任务。代码已开源。

原文摘要 · Abstract (English)

Event-based eye tracking holds significant promise for fine-grained cognitive state inference, offering high temporal resolution and robustness to motion artifacts, critical features for decoding subtle mental states such as attention, confusion, or fatigue. In this work, we introduce a model-agnostic, inference-time refinement framework designed to enhance the output of existing event-based gaze estimation models without modifying their architecture or requiring retraining. Our method comprises two key post-processing modules: (i) Motion-Aware Median Filtering, which suppresses blink-induced spikes while preserving natural gaze dynamics, and (ii) Optical Flow-Based Local Refinement, which aligns gaze predictions with cumulative event motion to reduce spatial jitter and temporal discontinuities. To complement traditional spatial accuracy metrics, we propose a novel Jitter Metric that captures the temporal smoothness of predicted gaze trajectories based on velocity regularity and local signal complexity. Together, these contributions significantly improve the consistency of event-based gaze signals, making them better suited for downstream tasks such as micro-expression analysis and mind-state decoding. Our results demonstrate consistent improvements across multiple baseline models on controlled datasets, laying the groundwork for future integration with multimodal affect recognition systems in real-world environments. Our code implementations can be found at https://github.com/eye-tracking-for-physiological-sensing/EyeLoRiN.

眼动追踪微表情识别事件相机后处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。