arXiv:2603.07166cs.CV2026-03被引 1

用双模型+遗忘机制,主动修正噪声标签导致的错误记忆。

ACD-U: Asymmetric co-teaching with machine unlearning for robust learning with noisy labels

  • 双模型异构协作:CLIP预训练模型提供稳定预测,CNN动态适应。
  • 高噪声下准确率超90%,在真实噪声数据集上表现领先。
  • 适合处理标签混乱场景,尤其对复杂噪声类型有强鲁棒性。

深度神经网络在训练中易记忆错误标签,降低泛化能力。现有方法虽结合样本选择与半监督学习利用记忆效应(先学干净数据,再学噪声数据),但一旦样本误判便无法纠正。为此,本文提出异构协同学习与机器遗忘框架ACD-U:首先采用对比语言-图像预训练(CLIP)视觉变换器与卷积神经网络(CNN)异构搭配,前者仅在干净样本上训练,后者通过半监督学习持续适应,有效缓解确认偏见;其次引入选择性遗忘机制,基于损失轨迹分析和CLIP一致性检查识别错误记忆样本,并通过KL散度实现遗忘,实现事后纠错。该方法将学习范式从被动避错转向主动纠错。在合成及真实噪声数据集(包括CIFAR-10/100、CIFAR-N、WebVision、Clothing1M、Red Mini-ImageNet)上的实验表明,在高噪声及实例相关噪声条件下均达到当前最优性能。代码已公开于https://github.com/meruemon/ACD-U。

原文摘要 · Abstract (English)

Deep neural networks are prone to memorizing incorrect labels during training, which degrades their generalizability. Although recent methods have combined sample selection with semi-supervised learning (SSL) to exploit the memorization effect -- where networks learn from clean data before noisy data -- they cannot correct selection errors once a sample is misclassified. To overcome this, we propose asymmetric co-teaching with different architectures (ACD)-U, an asymmetric co-teaching framework that uses different model architectures and incorporates machine unlearning. ACD-U addresses this limitation through two core mechanisms. First, its asymmetric co-teaching pairs a contrastive language-image pretraining (CLIP)-pretrained vision Transformer with a convolutional neural network (CNN), leveraging their complementary learning behaviors: the pretrained model provides stable predictions, whereas the CNN adapts throughout training. This asymmetry, where the vision Transformer is trained only on clean samples and the CNN is trained through SSL, effectively mitigates confirmation bias. Second, selective unlearning enables post-hoc error correction by identifying incorrectly memorized samples through loss trajectory analysis and CLIP consistency checks, and then removing their influence via Kullback--Leibler divergence-based forgetting. This approach shifts the learning paradigm from passive error avoidance to active error correction. Experiments on synthetic and real-world noisy datasets, including CIFAR-10/100, CIFAR-N, WebVision, Clothing1M, and Red Mini-ImageNet, demonstrate state-of-the-art performance, particularly in high-noise regimes and under instance-dependent noise. The code is publicly available at https://github.com/meruemon/ACD-U.

噪声标签协同学习机器遗忘视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。