arXiv:2505.13342cs.LG2025-05被引 2

通过识别并修正噪声标签,提升模型在含噪数据上的学习效果。

Detect and Correct: A Selective Noise Correction Method for Learning with Noisy Labels

  • 根据损失分布筛选可疑噪声样本,分步处理。
  • 仅修正噪声样本损失,保留正确数据信息。
  • 在图像与生物数据集上均显著提升准确率。

错误标注的样本(即噪声标签)会严重损害深度学习模型的性能。现有方法主要分为全局噪声估计和数据过滤两类:前者用噪声转移矩阵近似全数据集的噪声,但可能误调正确标签;后者剔除可疑样本,又可能丢失有价值数据。本文提出一种选择性噪声修正方法:首先基于损失分布识别潜在噪声样本,再通过筛选分离噪声与干净样本,并为噪声样本学习噪声转移矩阵以修正其损失,同时保持干净样本不受影响,从而优化训练过程。该方法在标准图像数据集(MNIST、CIFAR-10、CIFAR-100)及生物scRNA-seq细胞类型注释数据集上均表现出显著更高的模型准确率与鲁棒性。

原文摘要 · Abstract (English)

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise estimation approximates the noise across the entire dataset using a noise transition matrix, but it can unnecessarily adjust correct labels, leaving room for local improvements. Data filtering, on the other hand, discards potentially noisy samples but risks losing valuable data. Our method identifies potentially noisy samples based on their loss distribution. We then apply a selection process to separate noisy and clean samples and learn a noise transition matrix to correct the loss for noisy samples while leaving the clean data unaffected, thereby improving the training process. Our approach ensures robust learning and enhanced model performance by preserving valuable information from noisy samples and refining the correction process. We applied our method to standard image datasets (MNIST, CIFAR-10, and CIFAR-100) and a biological scRNA-seq cell-type annotation dataset. We observed a significant improvement in model accuracy and robustness compared to traditional methods.

噪声标签数据清洗模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。