用手机摄像头实现眼动追踪,对比商用红外设备表现
Evaluating Sensitivity Parameters in Smartphone-Based Gaze Estimation: A Comparative Study of Appearance-Based and Infrared Eye Trackers
- 结合MobileNet-V3与LSTM,从灰度人脸图预测视线坐标
- 平均误差17.76毫米,略高于商用设备的16.53毫米
- 在弱光、戴眼镜、老年人群中表现更差,适合移动端评估
本研究通过对比商用红外眼动仪Tobii Pro Nano,评估基于智能手机的深度学习眼动追踪算法在真实移动使用场景下的可行性。重点分析了年龄、性别、视力矫正、光照条件、设备类型和头部位置等关键敏感因素。该方法采用轻量级卷积神经网络MobileNet-V3与长短期记忆网络(LSTM)结合,从灰度人脸图像中预测注视坐标。实验采集了51名参与者在动态视觉刺激下的眼动数据,以欧氏距离衡量准确率。深度学习模型平均误差为17.76毫米,优于Tobii Pro Nano的16.53毫米。尽管总体差异小,但该方法对光照、视力矫正和年龄更为敏感,低光下戴眼镜者及老年群体失败率更高。设备型号与头部姿态也影响性能。结果表明,外观基眼动追踪在移动端具有潜力,并为跨使用场景的眼动系统评估提供参考框架。
原文摘要 · Abstract (English)
This study evaluates a smartphone-based, deep-learning eye-tracking algorithm by comparing its performance against a commercial infrared-based eye tracker, the Tobii Pro Nano. The aim is to investigate the feasibility of appearance-based gaze estimation under realistic mobile usage conditions. Key sensitivity factors, including age, gender, vision correction, lighting conditions, device type, and head position, were systematically analysed. The appearance-based algorithm integrates a lightweight convolutional neural network (MobileNet-V3) with a recurrent structure (Long Short-Term Memory) to predict gaze coordinates from grayscale facial images. Gaze data were collected from 51 participants using dynamic visual stimuli, and accuracy was measured using Euclidean distance. The deep learning model produced a mean error of 17.76 mm, compared to 16.53 mm for the Tobii Pro Nano. While overall accuracy differences were small, the deep learning-based method was more sensitive to factors such as lighting, vision correction, and age, with higher failure rates observed under low-light conditions among participants using glasses and in older age groups. Device-specific and positional factors also influenced tracking performance. These results highlight the potential of appearance-based approaches for mobile eye tracking and offer a reference framework for evaluating gaze estimation systems across varied usage conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。