arXiv:2501.01402cs.LG2025-01被引 1

提出改进的T-Revision方法,提升噪声标签下模型的鲁棒性。

Best Transition Matrix Esitimation or Best Label Noise Robustness Classifier? Two Possible Methods to Enhance the Performance of T-revision

  • 基于锚点假设和T-Revision系列方法估计噪声转移矩阵。
  • T-Revision-Alpha与Softmax增强算法稳定性与抗噪能力。
  • 在FashionMNIST和CIFAR-10上验证了方法的有效性,适合含噪声数据场景。

标签噪声指因人工错误或采集缺陷导致的数据集标签不准确,广泛存在于真实场景中,会显著降低模型精度。本文研究如何估计噪声转移矩阵并构建对标签噪声鲁棒的深度学习分类器。当转移矩阵已知时,采用前向校正与重要性重加权方法利用矩阵纠正噪声影响;当转移矩阵未知或不准时,使用锚点假设及T-Revision系列方法进行估计或修正。本研究进一步改进T-Revision方法,提出T-Revision-Alpha与T-Revision-Softmax以增强稳定性和鲁棒性。设计并实现了基于交叉熵损失的MLP与ResNet-18两个基线分类器。在具有已知噪声转移矩阵的FashionMNIST数据集上,比较各方法对干净标签的预测能力与转移矩阵估计效果;在噪声转移矩阵未知的CIFAR-10数据集上,估计噪声矩阵并评估其预测干净标签的能力。

原文摘要 · Abstract (English)

Label noise refers to incorrect labels in a dataset caused by human errors or collection defects, which is common in real-world applications and can significantly reduce the accuracy of models. This report explores how to estimate noise transition matrices and construct deep learning classifiers that are robust against label noise. In cases where the transition matrix is known, we apply forward correction and importance reweighting methods to correct the impact of label noise using the transition matrix. When the transition matrix is unknown or inaccurate, we use the anchor point assumption and T-Revision series methods to estimate or correct the noise matrix. In this study, we further improved the T-Revision method by developing T-Revision-Alpha and T-Revision-Softmax to enhance stability and robustness. Additionally, we designed and implemented two baseline classifiers, a Multi-Layer Perceptron (MLP) and ResNet-18, based on the cross-entropy loss function. We compared the performance of these methods on predicting clean labels and estimating transition matrices using the FashionMINIST dataset with known noise transition matrices. For the CIFAR-10 dataset, where the noise transition matrix is unknown, we estimated the noise matrix and evaluated the ability of the methods to predict clean labels.

标签噪声T-Revision鲁棒训练转移矩阵

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。