arXiv:2412.02373cs.CV2024-12被引 5

提出新损失函数,让模型更抗标签噪声,训练更快更稳。

Active Negative Loss: A Robust Framework for Learning with Noisy Labels

  • 用归一化负损失替代原方法中的平均绝对误差,聚焦干净样本。
  • 在多种噪声下性能优于或媲美当前最优方法,尤其在非对称噪声中表现更好。
  • 适合处理带噪声数据的图像分割任务,代码已开源。

深度监督学习在众多任务中取得显著成果,但在标签噪声存在时仍易过拟合。为应对这一问题,抗噪声损失函数提供有效解决方案。本文系统分析了近期提出的主动-被动损失(APL)的局限性:其被动部分采用平均绝对误差(MAE),虽具鲁棒性,但对干净与噪声样本同等对待,导致收敛缓慢,尤其在大规模数据集上训练困难。为此,我们提出一类新的被动损失函数——归一化负损失函数(NNLFs),在APL框架下有效聚焦于被记忆的干净样本。将APL中的MAE替换为NNLFs后,提出新的主动负损失(ANL)框架。此外,在非对称噪声场景中,引入基于熵的正则化以缓解标签不平衡带来的脆弱性。大量实验表明,所提框架在多种标签噪声类型和图像分割任务中均达到或超越当前最优性能。源代码已公开:https://github.com/Virusdoll/Active-Negative-Loss。

原文摘要 · Abstract (English)

Deep supervised learning has achieved remarkable success across a wide range of tasks, yet it remains susceptible to overfitting when confronted with noisy labels. To address this issue, noise-robust loss functions offer an effective solution for enhancing learning in the presence of label noise. In this work, we systematically investigate the limitation of the recently proposed Active Passive Loss (APL), which employs Mean Absolute Error (MAE) as its passive loss function. Despite the robustness brought by MAE, one of its key drawbacks is that it pays equal attention to clean and noisy samples; this feature slows down convergence and potentially makes training difficult, particularly in large-scale datasets. To overcome these challenges, we introduce a novel loss function class, termed Normalized Negative Loss Functions (NNLFs), which serve as passive loss functions within the APL framework. NNLFs effectively address the limitations of MAE by concentrating more on memorized clean samples. By replacing MAE in APL with our proposed NNLFs, we enhance APL and present a new framework called Active Negative Loss (ANL). Moreover, in non-symmetric noise scenarios, we propose an entropy-based regularization technique to mitigate the vulnerability to the label imbalance. Extensive experiments demonstrate that the new loss functions adopted by our ANL framework can achieve better or comparable performance to state-of-the-art methods across various label noise types and in image segmentation tasks. The source code is available at: https://github.com/Virusdoll/Active-Negative-Loss.

标签噪声损失函数图像分割鲁棒学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。