通过智能选样混合提升模型对噪声标签的鲁棒性
SelectMix: Enhancing Label Noise Robustness through Targeted Sample Mixing
- 基于置信度差异识别可疑样本,只对不确定样本进行混合
- 混合时使用多类软标签,使监督信号更贴近真实输入组合
- 在多个真实和合成数据集上均显著优于现有方法
深度神经网络容易记忆噪声标签,严重损害泛化性能。尽管Mixup在提升泛化性和鲁棒性方面表现良好,但现有方法通常盲目混合样本,缺乏样本选择与混合策略的合理指导,反而传播了噪声监督信号。为此,我们提出SelectMix,一种面向噪声标签的置信度引导混合框架。SelectMix首先通过置信度不匹配分析(结合K折交叉验证)识别可能含噪或模糊的样本,然后将这些不确定样本与同潜在类别中高置信度样本进行选择性混合。此外,SelectMix采用混合过程中所有涉及类别的软标签,确保标签准确反映混合样本的真实构成,使监督信号紧密匹配实际输入。在多个合成数据集(MNIST、Fashion-MNIST、CIFAR-10、CIFAR-100)和真实世界基准数据集(CIFAR-N、MNIST、Clothing1M)上的大量理论分析与实证评估表明,SelectMix持续优于强基线方法,验证了其在噪声标签学习中的有效性与鲁棒性。
原文摘要 · Abstract (English)
Deep neural networks tend to memorize noisy labels, severely degrading their generalization performance. Although Mixup has demonstrated effectiveness in improving generalization and robustness, existing Mixup-based methods typically perform indiscriminate mixing without principled guidance on sample selection and mixing strategy, inadvertently propagating noisy supervision. To overcome these limitations, we propose SelectMix, a confidence-guided mixing framework explicitly tailored for noisy labels. SelectMix first identifies potentially noisy or ambiguous samples through confidence based mismatch analysis using K-fold cross-validation, then selectively blends identified uncertain samples with confidently predicted peers from their potential classes. Furthermore, SelectMix employs soft labels derived from all classes involved in the mixing process, ensuring the labels accurately represent the composition of the mixed samples, thus aligning supervision signals closely with the actual mixed inputs. Through extensive theoretical analysis and empirical evaluations on multiple synthetic (MNIST, Fashion-MNIST, CIFAR-10, CIFAR-100) and real-world benchmark datasets (CIFAR-N, MNIST and Clothing1M), we demonstrate that SelectMix consistently outperforms strong baseline methods, validating its effectiveness and robustness in learning with noisy labels.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。