arXiv:2508.10268cs.CVcs.AI2025-08中稿 · British Machine Vi…

通过动态手机移动校准,提升移动端注视估计对头部姿态的鲁棒性。

Pose-Robust Calibration Strategy for Point-of-Gaze Estimation on Mobile Phones

  • 用户移动手机时注视校准点,自然引入姿态变化。
  • 在32人数据集上,新策略使姿态敏感度降低23%。
  • 适合移动端注视估计应用,尤其对非固定姿态场景优化显著。

尽管基于外观的注视点(PoG)估计已取得进展,但因个体差异,现有方法仍难以跨人泛化,需进行个性化校准。然而,传统校准结果常对头部姿态变化敏感。为此,我们分析了影响校准性能的关键因素,并提出姿态鲁棒的校准策略。首先构建了包含32名个体在固定或连续变化头姿下注视指定点的基准数据集MobilePoG。实验表明,校准阶段引入更广泛头姿可显著提升模型对姿态变化的适应能力。基于此,我们提出一种动态校准策略:用户在移动手机的同时注视校准点,实现高效且用户友好的姿态多样性注入。该策略生成的校准模型对头姿变化的敏感度显著低于传统方法。代码与数据集已公开。

原文摘要 · Abstract (English)

Although appearance-based point-of-gaze (PoG) estimation has improved, the estimators still struggle to generalize across individuals due to personal differences. Therefore, person-specific calibration is required for accurate PoG estimation. However, calibrated PoG estimators are often sensitive to head pose variations. To address this, we investigate the key factors influencing calibrated estimators and explore pose-robust calibration strategies. Specifically, we first construct a benchmark, MobilePoG, which includes facial images from 32 individuals focusing on designated points under either fixed or continuously changing head poses. Using this benchmark, we systematically analyze how the diversity of calibration points and head poses influences estimation accuracy. Our experiments show that introducing a wider range of head poses during calibration improves the estimator's ability to handle pose variation. Building on this insight, we propose a dynamic calibration strategy in which users fixate on calibration points while moving their phones. This strategy naturally introduces head pose variation during a user-friendly and efficient calibration process, ultimately producing a better calibrated PoG estimator that is less sensitive to head pose variations than those using conventional calibration strategies. Codes and datasets are available at our project page.

注视估计移动端姿态鲁棒校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。