arXiv:2409.18561cs.CV2024-09中稿 · ACM Multimedia 202…被引 1

用主动学习减少标注数据,仅用一半数据达到顶尖效果。

AL-GTD: Deep Active Learning for Gaze Target Detection

  • 结合监督与自监督损失,设计新采样函数选择最有价值样本。
  • 仅用40%-50%数据即超越现有模型,10%-20%数据已达满意性能。
  • 适合数据稀缺场景,尤其适用于标注成本高的视觉注意力研究。

视线目标检测旨在确定人注视的图像位置。尽管现有研究通过回归精确的注视热图取得了显著进展,但这些成果大多依赖于大规模标注数据集,需大量人工标注。本文旨在降低对标注训练数据量的依赖。为此,提出AL-GTD,一种将监督与自监督损失融合于新型样本获取函数中的主动学习方法,并利用伪标签缓解训练过程中的分布偏移问题。AL-GTD仅使用40%-50%的训练数据,便在所有AUC指标上达到最优表现,而当前最先进(SOTA)模型需使用全部数据才能达成相同性能。更重要的是,仅用10%-20%数据即可快速达到良好性能,验证了所提获取函数能有效选取最具信息量的样本。我们通过适配多种主动学习方法进行全面实验分析,结果表明,AL-GTD不仅优于其他主动学习方法,在低数据环境下也显著超越当前SOTA注视目标检测器。代码已公开于https://github.com/francescotonini/al-gtd。

原文摘要 · Abstract (English)

Gaze target detection aims at determining the image location where a person is looking. While existing studies have made significant progress in this area by regressing accurate gaze heatmaps, these achievements have largely relied on access to extensive labeled datasets, which demands substantial human labor. In this paper, our goal is to reduce the reliance on the size of labeled training data for gaze target detection. To achieve this, we propose AL-GTD, an innovative approach that integrates supervised and self-supervised losses within a novel sample acquisition function to perform active learning (AL). Additionally, it utilizes pseudo-labeling to mitigate distribution shifts during the training phase. AL-GTD achieves the best of all AUC results by utilizing only 40-50% of the training data, in contrast to state-of-the-art (SOTA) gaze target detectors requiring the entire training dataset to achieve the same performance. Importantly, AL-GTD quickly reaches satisfactory performance with 10-20% of the training data, showing the effectiveness of our acquisition function, which is able to acquire the most informative samples. We provide a comprehensive experimental analysis by adapting several AL methods for the task. AL-GTD outperforms AL competitors, simultaneously exhibiting superior performance compared to SOTA gaze target detectors when all are trained within a low-data regime. Code is available at https://github.com/francescotonini/al-gtd.

主动学习视线检测低数据训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。