自适应学习噪声分布,提升模型在异常噪声下的鲁棒性。
ALCL: An Adaptive Log-Correntropy Loss for Robust Learning under Non-Gaussian Noise

- 设计可自适应学习参数的对数型核损失,动态调整抗噪几何结构。
- 在高噪声下图像重建与分类准确率提升最高达4.75%,方差更低。
- 适合处理含极端异常值的非高斯噪声场景,如图像去噪、医疗影像修复。
在重尾和脉冲噪声下实现鲁棒深度学习仍具挑战性,因传统损失函数如均方误差(MSE)对异常值敏感且无界。尽管基于相关熵的目标函数提升了鲁棒性,但现有方法依赖固定核参数,需人工调参且训练中保持不变。为此,我们提出自适应对数相关熵损失(ALCL),一种能动态学习其鲁棒性几何结构的重尾损失。ALCL引入对数残差模型,其形状与尺度参数通过可微重参数化与网络权重联合学习,形成合理的最大似然框架,其影响函数有界且呈递减趋势,使损失结构能随残差统计特性动态调整,并有效抑制极端异常值。在四个常用基准数据集上的对比实验表明,无论灰度或彩色图像,在混合重尾与脉冲噪声下,ALCL始终优于MSE及最优调参的广义相关熵损失,在重建保真度和下游分类准确率上表现更优。低噪声条件下性能差异较小,但在高噪声环境下,灰度基准上中位准确率最高提升4.75%,彩色数据集提升4.51%,跨运行方差显著降低。结果表明,通过联合学习损失参数实现自适应鲁棒性,是应对非高斯环境深度学习的高效替代方案。
原文摘要 · Abstract (English)
Robust deep learning under heavy-tailed and impulsive noise remains challenging because conventional losses such as mean squared error (MSE) exhibit unbounded sensitivity to outliers. Although correntropy-based objectives improve robustness, existing formulations rely on fixed kernel parameters that must be empirically tuned and remain static during training. To address these limitations, we propose an Adaptive Log-Correntropy Loss (ALCL), a heavy-tailed loss formulation that adaptively learns its robustness geometry during optimization. ALCL introduces a logarithmic residual model whose shape and scale parameters are learned jointly with network weights through differentiable reparameterization. This yields a principled maximum likelihood formulation whose influence function is formally bounded and redescending, allowing the loss geometry to adapt dynamically to evolving residual statistics while suppressing extreme outliers. Comparative experiments on four widely used benchmark datasets spanning grayscale and red-green-blue (RGB) image data under mixed heavy-tailed and impulsive noise demonstrate that ALCL consistently outperforms MSE and optimally tuned generalized correntropy losses in both reconstruction fidelity and downstream classification accuracy. While performance differences remain small under low-noise conditions, under high-noise regimes ALCL improves median accuracy by up to 4.75% on grayscale benchmarks and 4.51% on RGB datasets, with reduced variance across runs. These results demonstrate that adaptive robustness through joint learning of loss parameters provides a computationally efficient alternative to static correntropy-based losses for deep learning in non-Gaussian environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。