arXiv:2410.15605cs.CVcs.AI2024-10被引 2

用轨迹采样修复标签数据偏差,提升模型标注效率

Deep Active Learning with Manifold-preserving Trajectory Sampling

  • 通过保持流形结构的轨迹采样,修正标签数据带来的偏差
  • 在多个视觉与非视觉数据集上,显著优于现有深度主动学习方法
  • 适合关注标注效率与模型泛化性能的研究者

主动学习(AL)旨在优化未标注数据的选择以减少标注成本并提升模型性能。其核心挑战在于如何选择最具信息量的未标注样本进行标注。现有深度主动学习方法常因标签数据占比过低而产生偏差,这一问题在视觉与非视觉数据中均较严重。为此,本文提出一种新方法——流形保持轨迹采样(MPTS),通过使标签数据学习到的特征空间更准确地反映真实流形结构,有效纠正标签数据引入的偏差,从而避免对未标注数据的偏倚选择。该方法可通过最大均值差异(MMD)实现分布映射,易于实施。在多个视觉与非视觉基准数据集上的大量实验表明,该方法具有明显优势。代码已公开。

原文摘要 · Abstract (English)

Active learning (AL) is for optimizing the selection of unlabeled data for annotation (labeling), aiming to enhance model performance while minimizing labeling effort. The key question in AL is which unlabeled data should be selected for annotation. Existing deep AL methods arguably suffer from bias incurred by clabeled data, which takes a much lower percentage than unlabeled data in AL context. We observe that such an issue is severe in different types of data, such as vision and non-vision data. To address this issue, we propose a novel method, namely Manifold-Preserving Trajectory Sampling (MPTS), aiming to enforce the feature space learned from labeled data to represent a more accurate manifold. By doing so, we expect to effectively correct the bias incurred by labeled data, which can cause a biased selection of unlabeled data. Despite its focus on manifold, the proposed method can be conveniently implemented by performing distribution mapping with MMD (Maximum Mean Discrepancies). Extensive experiments on various vision and non-vision benchmark datasets demonstrate the superiority of our method. Our source code can be found here.

主动学习流形学习深度学习标注效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。