提出新框架缓解标注噪声,提升眼动估计跨域泛化能力
See Through the Noise: Improving Domain Generalization in Gaze Estimation

- 构建语义嵌入空间,通过原型变换保持特征与标签拓扑一致
- 利用特征-标签一致性识别噪声样本,实现干净样本信息迁移
- 无需牺牲源域性能,显著提升跨域泛化效果,适合实际部署
由于真实应用场景对泛化眼动估计方法的迫切需求,该领域已取得显著进展。然而,现有方法常忽视标注噪声——源于精确眼动标注的固有难度——对模型泛化性能的负面影响。本文首次系统研究了标签噪声对眼动估计泛化性能的负面作用,并提出一种新颖的See-Through-Noise(SeeTN)框架,从缓解标签噪声角度提升泛化能力。具体地,我们通过原型基变换构建语义嵌入空间,以保持注视特征与连续标签间的稳定拓扑结构;进而通过度量特征-标签亲和性一致性来区分噪声与干净样本,并在语义流形上引入新型亲和性正则化,将干净样本中的注视相关信息迁移到噪声样本中。所提方法促进语义结构对齐并强制域不变的注视关系,从而增强对标签噪声的鲁棒性。大量实验表明,SeeTN能有效缓解源域噪声的不利影响,在不降低源域准确率的前提下实现更优的跨域泛化性能,凸显了在泛化眼动估计中显式处理噪声的重要性。
原文摘要 · Abstract (English)
Generalizable gaze estimation methods have garnered increasing attention due to their critical importance in real-world applications and have achieved significant progress. However, they often overlook the effect of label noise, arising from the inherent difficulty of acquiring precise gaze annotations, on model generalization performance. In this paper, we are the first to comprehensively investigate the negative effects of label noise on generalization in gaze estimation. Further, we propose a novel solution, called See-Through-Noise (SeeTN) framework, which improves generalization from a novel perspective of mitigating label noise. Specifically, we propose to construct a semantic embedding space via a prototype-based transformation to preserve a consistent topological structure between gaze features and continuous labels. We then measure feature-label affinity consistency to distinguish noisy from clean samples, and introduce a novel affinity regularization in the semantic manifold to transfer gaze-related information from clean to noisy samples. Our proposed SeeTN promotes semantic structure alignment and enforces domain-invariant gaze relationships, thereby enhancing robustness against label noise. Extensive experiments demonstrate that our SeeTN effectively mitigates the adverse impact of source-domain noise, leading to superior cross-domain generalization without compromising the source-domain accuracy, and highlight the importance of explicitly handling noise in generalized gaze estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。