arXiv:2502.16104cs.LGcs.CV2025-02被引 1

用噪声数据反制噪声标签,无需干净验证集也能高效纠错。

Set a Thief to Catch a Thief: Combating Label Noise through Noisy Meta Learning

  • 用与训练数据同分布的噪声数据充当验证集,实现元学习纠错。
  • 在80%对称噪声下,CIFAR-10上标签纠错率达96.9%,分类准确率达95.2%。
  • 适合无干净验证集的高噪声场景,尤其适用于真实世界数据集。

从噪声标签中学习(LNL)旨在利用带噪声的数据集训练高性能深度模型。基于元学习的标签修正方法通过设计多种元标签修正任务,在LNL中表现出色,但其前提需要额外的干净验证集,增加了人工成本,严重限制了实用性。为此,我们提出新颖的噪声元标签修正框架STCT,反直觉地利用噪声数据来修正标签噪声,呼应“以贼制贼”的理念。STCT的核心思想是将与训练数据同分布的噪声数据作为验证集,在元学习框架下评估模型性能并执行标签修正,从而无需额外清洁数据。通过将复杂的双层优化解耦为表示学习和标签修正,STCT采用噪声元修正与半监督表示学习交替训练的方式求解。在合成与真实数据集上的大量实验表明,STCT表现卓越,尤其在高噪声率场景下。在80%对称噪声的CIFAR-10上,标签修正率达到96.9%,分类性能达95.2%,显著超越当前最先进水平。

原文摘要 · Abstract (English)

Learning from noisy labels (LNL) aims to train high-performance deep models using noisy datasets. Meta learning based label correction methods have demonstrated remarkable performance in LNL by designing various meta label rectification tasks. However, extra clean validation set is a prerequisite for these methods to perform label correction, requiring extra labor and greatly limiting their practicality. To tackle this issue, we propose a novel noisy meta label correction framework STCT, which counterintuitively uses noisy data to correct label noise, borrowing the spirit in the saying ``Set a Thief to Catch a Thief''. The core idea of STCT is to leverage noisy data which is i.i.d. with the training data as a validation set to evaluate model performance and perform label correction in a meta learning framework, eliminating the need for extra clean data. By decoupling the complex bi-level optimization in meta learning into representation learning and label correction, STCT is solved through an alternating training strategy between noisy meta correction and semi-supervised representation learning. Extensive experiments on synthetic and real-world datasets demonstrate the outstanding performance of STCT, particularly in high noise rate scenarios. STCT achieves 96.9% label correction and 95.2% classification performance on CIFAR-10 with 80% symmetric noise, significantly surpassing the current state-of-the-art.

噪声标签元学习自修正数据清洗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。