arXiv:2606.03774cs.CV2026-06

用自然光拍摄260万张眼球图像,验证无主动红外光照下瞳孔分割可行性

AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination

论文配图:AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination
图 1 · 摘自论文原文
  • 仅用被动红外摄像头捕捉户外自然光照下的眼图像
  • 在自然光下瞳孔分割准确率下降至0.767,显著低于可控红外环境
  • 为无源眼动追踪提供首个大规模真实场景基准数据集

眼动追踪对智能眼镜至关重要,可为环境智能应用提供用户注意力信息。然而,现有系统大多依赖主动红外(IR)照明,在户外全天使用时因功耗高而受限。本文研究仅靠被动红外相机、不使用任何主动红外光源,能否在非受控户外环境中实现可靠的瞳孔检测,其中自然阳光作为唯一光源。为此,我们提出了AmbientEye,一个包含2,606,225张眼球图像的大规模数据集,来自35名来自19个国家的参与者,均在户外自然阳光下采集,采用两种偏轴相机配置和两种太阳朝向条件。通过SAM2自动分割结合人工精修,提供高质量瞳孔标注。我们在该数据集上对当前最先进的瞳孔分割算法进行基准测试,并与在受控红外光照下现有数据集的表现对比。结果表明,性能从受控红外数据集的0.928大幅下降至AmbientEye的0.767。这一差距凸显了环境光条件下的挑战。AmbientEye因此成为探索这一未充分研究且高度实用的眼动追踪场景的首个基准。

原文摘要 · Abstract (English)

Eye tracking is essential for smart glasses, as it provides insight into user attention for ambient intelligence applications. However, most existing eye-tracking systems rely on active infrared (IR) illumination, creating practical barriers to all-day outdoor use due to power consumption. In this paper, we investigate whether passive IR cameras alone, without any active IR light source, can enable reliable pupil detection in unconstrained outdoor environments, where ambient sunlight serves as the sole illumination source. To support this investigation, we introduce AmbientEye, a large-scale dataset of 2,606,225 eye images collected from 35 participants from 19 countries. It is captured outdoors under natural sunlight with two off-axis camera configurations and two sun-orientation conditions. We provide high-quality pupil annotation through SAM2 automatic segmentation, followed by refinement by human annotators. We benchmark a state-of-the-art pupil segmentation algorithm on our dataset and compare its performance with that on existing datasets under controlled IR illumination. Results reveal a substantial drop in pupil segmentation performance from 0.928 on controlled IR datasets to 0.767 on AmbientEye. This performance gap highlights the challenge of the ambient-light setting. This positions AmbientEye as a first benchmark for an unexplored and highly practical eye-tracking scenario.

眼动追踪红外成像数据集自然光照

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。