arXiv:2607.16768cs.LG2026-07

从单变量函数构建抗噪损失,提升模型在错误标签下的训练鲁棒性。

Robust Losses from Univariate Base Functions for Noisy-Label Learning

论文配图:Robust Losses from Univariate Base Functions for Noisy-Label Learning
图 1 · 摘自论文原文
  • 基于单变量函数构造多分类损失,通过函数性质直接推导鲁棒性。
  • 两种构建方式在不同噪声场景下均优于或媲美现有方法。
  • 适合需要高鲁棒性的实际数据集标签清洗与模型训练场景。

带噪声标签的学习是训练可靠深度神经网络的核心挑战。稳健的损失函数能有效缓解标签噪声的负面影响。然而,大多数现有稳健损失直接在最终多分类目标层面设计,难以系统分析和扩展其鲁棒性。本文提出一个通用框架,从单变量基函数构建稳健的多分类损失。通过定义从基函数到多分类损失的映射算子,所生成损失的鲁棒性可由基函数的简单性质刻画。我们提出两种互补的构造方案:目标分离(对应类间独立)和二元化简(对应类间依赖)。针对两者分别分析对称性与非对称性,推导出相应的充分条件,为抗噪声损失设计提供理论依据。该框架还为构造对称损失提供了新路径,补充了基于归一化的对称损失设计。在合成数据与真实世界噪声标签基准上的大量实验表明,所提损失在多种噪声设置下表现优异或更优。

原文摘要 · Abstract (English)

Learning with noisy labels is a fundamental problem in training reliable deep neural networks. Robust loss functions provide a direct and effective way to mitigate the adverse effects of label noise. However, most existing robust losses are designed directly at the level of the final multiclass objective, which makes it difficult to systematically characterize and extend their robustness properties. In this paper, we propose a general framework that constructs robust multiclass losses from univariate base functions. By defining mapping operators from base functions to multiclass losses, the robustness of the induced losses can be characterized through simple properties of the base functions. We develop two complementary construction schemes, Target Separation and Binary Reduction, corresponding to inter-class independent and inter-class dependent formulations, respectively. For both schemes, we analyze their symmetry and asymmetry properties and derive corresponding sufficient conditions, which provide theoretical criteria for noise-robust loss design. The proposed framework also provides a new route to constructing symmetric losses, serving as a complement to normalization-based symmetric loss designs. Extensive experiments on synthetic and real-world noisy-label benchmarks demonstrate that the proposed losses achieve competitive or superior performance under various noise settings.

抗噪学习损失函数深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。