提出新型联合不对称损失,有效缓解噪声标签问题。
Joint Asymmetric Loss for Learning with Noisy Labels
- 设计不对称损失函数AMSE,增强模型对噪声的鲁棒性
- 在多个数据集上显著提升噪声标签下的准确率
- 适合处理真实场景中存在标注错误的深度学习任务
带噪声标签的学习是训练精准深度神经网络的关键任务。现有研究多采用对称损失函数,但常因约束过严导致欠拟合。为此,本文提出一种新方法:将不对称损失扩展至被动损失场景,构建新型不对称均方误差(AMSE)损失函数,并严格证明其满足不对称条件的充要条件。通过将APL框架中的传统对称被动损失替换为AMSE,提出联合不对称损失(JAL)框架。大量实验表明,该方法在多种噪声环境下均显著提升模型性能。代码已公开于https://github.com/cswjl/joint-asymmetric-loss。
原文摘要 · Abstract (English)
Learning with noisy labels is a crucial task for training accurate deep neural networks. To mitigate label noise, prior studies have proposed various robust loss functions, particularly symmetric losses. Nevertheless, symmetric losses usually suffer from the underfitting issue due to the overly strict constraint. To address this problem, the Active Passive Loss (APL) jointly optimizes an active and a passive loss to mutually enhance the overall fitting ability. Within APL, symmetric losses have been successfully extended, yielding advanced robust loss functions. Despite these advancements, emerging theoretical analyses indicate that asymmetric losses, a new class of robust loss functions, possess superior properties compared to symmetric losses. However, existing asymmetric losses are not compatible with advanced optimization frameworks such as APL, limiting their potential and applicability. Motivated by this theoretical gap and the prospect of asymmetric losses, we extend the asymmetric loss to the more complex passive loss scenario and propose the Asymetric Mean Square Error (AMSE), a novel asymmetric loss. We rigorously establish the necessary and sufficient condition under which AMSE satisfies the asymmetric condition. By substituting the traditional symmetric passive loss in APL with our proposed AMSE, we introduce a novel robust loss framework termed Joint Asymmetric Loss (JAL). Extensive experiments demonstrate the effectiveness of our method in mitigating label noise. Code available at: https://github.com/cswjl/joint-asymmetric-loss
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。