用关键点做眼神估计,轻量高效且可解释,跨数据集表现接近深度模型。
Is Geometry Enough? An Evaluation of Landmark-Based Gaze Estimation
- 基于面部关键点构建轻量回归模型,避免复杂黑箱网络。
- 跨域测试中模型性能接近ResNet18基线,验证泛化能力。
- 适合对效率与可解释性要求高的边缘设备应用。
基于外观的眼镜估计通常依赖深度卷积神经网络,虽精度高但计算开销大且缺乏可解释性。基于面部关键点的几何方法是轻量级替代方案,但其性能极限与泛化能力在现代基准下仍不明确。本研究对关键点法进行系统评估:从Gaze360、ETH-XGaze和GazeGene三个大规模数据集提取并归一化关键点,训练三种轻量回归模型——极端梯度提升树、全连接MLP及双分支MLP(捕捉双眼几何)。结果发现,同域评估中性能较低,可能因关键点检测器引入噪声;但在跨域评估中,提出的MLP架构表现出与ResNet18相当的泛化能力。这表明稀疏几何特征足以支撑鲁棒的眼神估计,为高效、可解释且隐私友好的边缘应用铺平道路。代码与生成的数据集已开源。
原文摘要 · Abstract (English)
Appearance-based gaze estimation frequently relies on deep Convolutional Neural Networks (CNNs). These models are accurate, but computationally expensive and act as "black boxes", offering little interpretability. Geometric methods based on facial landmarks are a lightweight alternative, but their performance limits and generalization capabilities remain underexplored in modern benchmarks. In this study, we conduct a comprehensive evaluation of landmark-based gaze estimation. We introduce a standardized pipeline to extract and normalize landmarks from three large-scale datasets (Gaze360, ETH-XGaze, and GazeGene) and train lightweight regression models, specifically Extreme Gradient Boosted trees and two neural architectures: a holistic Multi-Layer Perceptron (MLP) and a siamese MLP designed to capture binocular geometry. We find that landmark-based models exhibit lower performance in within-domain evaluation, likely due to noise introduced into the datasets by the landmark detector. Nevertheless, in cross-domain evaluation, the proposed MLP architectures show generalization capabilities comparable to those of ResNet18 baselines. These findings suggest that sparse geometric features encode sufficient information for robust gaze estimation, paving the way for efficient, interpretable, and privacy-friendly edge applications. The source code and generated landmark-based datasets are available at https://github.com/daniele-agostinelli/LandmarkGaze.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。