arXiv:2606.16524cs.LGastro-ph.CO2026-06

一种能识别数据污染的鲁棒损失,同时提升模型抗干扰能力。

Neural Bayesian Anomaly Mitigation: A Robust Loss that Doubles as an Unsupervised Contamination Classifier

论文配图:Neural Bayesian Anomaly Mitigation: A Robust Loss that Doubles as an Unsupervised Contamination Classifier
图 1 · 摘自论文原文
  • 基于贝叶斯混合模型设计新损失,兼具鲁棒训练与异常检测功能。
  • 在CIFAR-10上以0.2~0.6污染率下优于四种基线方法。
  • 可自动学习污染空间结构,适合处理标签噪声场景。

Huber、Student-t和广义交叉熵等鲁棒损失虽能提升模型对数据污染的容忍度,但无法识别具体污染样本。本文提出神经贝叶斯异常缓解(NBAM),一种通用的即插即用损失:其边缘似然构成鲁棒监督损失,后验分布则生成无监督污染分类器。类似Huber或Student-t,NBAM可直接替代任意监督训练中的标准损失;不同于它们的是,它还能学习结构化污染模型并输出校准的逐样本污染后验。通过学习输入依赖的先验π_ϕ(x),捕捉污染的空间局部性,使靠近已知污染样本的样本更易被标记;同时自动产生奥卡姆惩罚,防止过度误报。在带有非对称标签污染的CIFAR-10上,NBAM无需监督即可恢复污染结构:污染后验能有效区分干净与污染样本,且学习到的异常头可识别每对标签翻转的方向。此外,在污染率0.2~0.6区间内,其性能优于四种鲁棒损失基线。

原文摘要 · Abstract (English)

Engineered robust losses such as Huber, Student-$t$, and generalised cross-entropy make supervised models tolerant of contamination but cannot answer which observations are corrupted. We introduce Neural Bayesian Anomaly Mitigation (NBAM), a general-purpose drop-in loss derived from a Bayesian latent-switch mixture model: the marginal likelihood defines a robust supervised loss, and the associated posterior defines an unsupervised contamination classifier. Like Huber or Student-$t$, NBAM can replace the standard training loss in any supervised pipeline; unlike them, it additionally learns a structured contamination model and returns a calibrated per-sample contamination posterior. A learned input-dependent prior $π_ϕ(x)$ captures the spatial locality of contamination, so that samples near known corruptions are more likely to be flagged, while an Occam penalty emerges automatically and regularises against over-flagging. On CIFAR-10 with asymmetric label contamination, NBAM recovers the structure of the corruption process without supervision: the contamination posterior separates clean from corrupted samples, and the learned anomaly head identifies the direction of every label-flip pair. Alongside these capabilities, NBAM outperforms the four robust-loss baselines considered here at contamination rates 0.2-0.6.

鲁棒学习异常检测标签噪声

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。