arXiv:2605.27080cs.CV2026-05

通过解耦特征空间提升眼动估计泛化能力,大幅减少标注数据需求。

Semi-Supervised Gaze Estimation via Disentangled Subspace Contrastive Learning

论文配图:Semi-Supervised Gaze Estimation via Disentangled Subspace Contrastive Learning
图 1 · 摘自论文原文
  • 将特征分解为独立的俯仰/偏航子空间,用雅可比正则化实现解耦。
  • 仅用5%标注数据即达主流性能,在跨域场景下仍保持稳定表现。
  • 适合数据稀缺或需快速适配新场景的眼动研究与应用开发。

基于外观的眼动估计常因标注样本有限和数据集多样性不足而泛化能力差。现有方法采用弱监督学习从真实世界无约束场景生成大规模伪标签数据,以缓解域偏移问题。本文提出一种简单有效的半监督学习架构,利用未标注数据增强模型域泛化能力,降低对人工标注的依赖。核心思想是引入雅可比正则化,将特征表示解耦至专用于特定注视方向(如俯仰角、偏航角)的子空间。进一步在每个子空间内利用内在序数关系进行对比学习,使模型能从少量标注样本和大量未标注数据中学习鲁棒的注视表征。该框架称为解耦子空间对比学习(DSCL)。多基准测试表明,DSCL可即插即用,在仅使用20%、10%甚至5%标注数据的情况下,于域内与跨域评估设置下均取得有竞争力的性能。代码已公开于:https://github.com/da60266/DSCL。

原文摘要 · Abstract (English)

Appearance-based gaze estimation always suffers from poor generalization due to limited annotated samples and insufficient dataset diversity. Leading approaches adopt weakly supervised learning to generate large-scale pseudo-labeled data from unconstrained real-world scenarios, aiming to mitigate the domain shifts. In this work, we devise a simple yet effective semi-supervised learning architecture that leverages unlabeled data to enhance domain generalization, thereby reducing reliance on labor-intensive manual annotations. Our key insight is to impose Jacobian regularization to disentangle feature representations into discriminative subspaces dedicated to specific gaze components, such as pitch and yaw angles. We further exploit the intrinsic ordinal ranking within each subspace for contrastive learning, enabling the model to learn robust gaze representations from a small set of labeled samples and an abundance of unlabeled ones. This ultimately yields our Disentangled Subspace Contrastive Learning (DSCL) framework. Extensive experiments on multiple benchmarks verify that the proposed DSCL is plug-and-play, achieving competitive performance using only 20\%, 10\%, and even 5\% of the annotated data under both in-domain and cross-domain evaluation settings. The public code is available at \href{https://github.com/da60266/DSCL}{https://github.com/da60266/DSCL}.

眼动估计半监督解耦表征对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。