arXiv:2409.18813cs.CVcs.HC2024-09被引 9

用事件相机实现高精度低延迟眼动追踪,还能当生物识别指纹用。

EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicing

  • 自适应事件切片算法动态积累数据,匹配不同眼动模式。
  • 追踪精度提升6%以上,IoU达92%,延迟比同类方法低3倍。
  • 捕捉微小瞳孔运动差异,可作个人生物特征认证。

眼动追踪技术在人机交互、虚拟/增强现实及可穿戴健康领域日益重要。传统基于RGB相机的系统常因时间分辨率低和计算限制,难以捕捉快速眼动。为此,我们提出EyeTrAES,采用类脑事件相机实现高保真自然瞳孔运动追踪,该运动具有显著的运动学差异。其核心是新型自适应窗口切片算法,能在不同眼动模式下精准累积所需异步事件数据。随后对单只眼睛的累积事件帧进行轻量级图像处理,完成瞳孔分割与追踪。实验表明,该方法使瞳孔追踪精度提升6%以上,达到约92%的交并比(IoU),且延迟至少降低3倍于现有纯事件基眼动追踪方案[38]。此外,EyeTrAES捕获的微观瞳孔运动表现出个体间显著差异,可作为生物特征指纹。为实现鲁棒用户认证,我们基于短时瞳孔运动学特征向量(包含滑动窗口内的瞳孔位置、速度、加速度三元组)训练轻量级用户专属随机森林分类器。在两个不同数据集上的实验证明,该认证方法可同时实现约0.82的高准确率与约12ms的低处理延迟,显著优于多个先进基准方法。

原文摘要 · Abstract (English)

Eye-tracking technology has gained significant attention in recent years due to its wide range of applications in human-computer interaction, virtual and augmented reality, and wearable health. Traditional RGB camera-based eye-tracking systems often struggle with poor temporal resolution and computational constraints, limiting their effectiveness in capturing rapid eye movements. To address these limitations, we propose EyeTrAES, a novel approach using neuromorphic event cameras for high-fidelity tracking of natural pupillary movement that shows significant kinematic variance. One of EyeTrAES's highlights is the use of a novel adaptive windowing/slicing algorithm that ensures just the right amount of descriptive asynchronous event data accumulation within an event frame, across a wide range of eye movement patterns. EyeTrAES then applies lightweight image processing functions over accumulated event frames from just a single eye to perform pupil segmentation and tracking. We show that these methods boost pupil tracking fidelity by 6+%, achieving IoU~=92%, while incurring at least 3x lower latency than competing pure event-based eye tracking alternatives [38]. We additionally demonstrate that the microscopic pupillary motion captured by EyeTrAES exhibits distinctive variations across individuals and can thus serve as a biometric fingerprint. For robust user authentication, we train a lightweight per-user Random Forest classifier using a novel feature vector of short-term pupillary kinematics, comprising a sliding window of pupil (location, velocity, acceleration) triples. Experimental studies with two different datasets demonstrate that the EyeTrAES-based authentication technique can simultaneously achieve high authentication accuracy (~=0.82) and low processing latency (~=12ms), and significantly outperform multiple state-of-the-art competitive baselines.

眼动追踪事件相机生物识别低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。