arXiv:2412.15601cs.CV2024-12AAAI被引 8

解决视线估计中的标签偏差问题,提升跨域性能

Gaze Label Alignment: Alleviating Domain Shift for Gaze Estimation

  • 通过特征提取与标签映射对齐不同域的视线标签分布
  • 在多个数据集上验证,显著降低标签分布偏移
  • 可集成到现有方法中,适合跨域视线估计研究者

视线估计模型在跨域测试时性能明显下降,主要源于训练与测试数据间的领域差异。现有方法多关注数据分布差异,却忽略了因采集方式和个体生理差异导致的标签偏差。本文首次指出标签偏差不可忽视,提出视线标签对齐算法(GLA)以消除标签分布偏移。具体而言,先在所有域上训练特征提取器获取域不变特征,再选定一个参考域训练视线回归器;随后预测其余域的视线标签,并通过映射函数进行对齐。这些对齐后的标签可用于训练更鲁棒的视线估计模型。实验表明,本方法能有效缓解标签分布偏移,显著提升现有先进方法的性能。

原文摘要 · Abstract (English)

Gaze estimation methods encounter significant performance deterioration when being evaluated across different domains, because of the domain gap between the testing and training data. Existing methods try to solve this issue by reducing the deviation of data distribution, however, they ignore the existence of label deviation in the data due to the acquisition mechanism of the gaze label and the individual physiological differences. In this paper, we first point out that the influence brought by the label deviation cannot be ignored, and propose a gaze label alignment algorithm (GLA) to eliminate the label distribution deviation. Specifically, we first train the feature extractor on all domains to get domain invariant features, and then select an anchor domain to train the gaze regressor. We predict the gaze label on remaining domains and use a mapping function to align the labels. Finally, these aligned labels can be used to train gaze estimation models. Therefore, our method can be combined with any existing method. Experimental results show that our GLA method can effectively alleviate the label distribution shift, and SOTA gaze estimation methods can be further improved obviously.

视线估计域适应标签对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。