arXiv:2603.17255cs.LG2026-03IJCV被引 15

提出一种新方法,让模型自动修正噪声标签,提升训练鲁棒性。

Variational Rectification Inference for Learning with Noisy Labels

论文配图:Variational Rectification Inference for Learning with Noisy Labels
图 1 · 摘自论文原文
  • 将损失修正建模为变分推断问题,用隐变量动态调整错误标签的损失。
  • 在开放集噪声下准确率提升10%以上,显著优于传统方法。
  • 适合数据标注不靠谱的场景,如真实世界图像分类任务。

标签噪声广泛存在于真实数据集中。为缓解深度模型对标签噪声的过拟合问题,现有方法(如重加权或损失修正)多在元学习框架下实现。尽管概率元学习模型具备一定抗噪能力,但常出现模型坍塌,导致泛化性能下降。本文提出变分修正推断(VRI),将损失函数的自适应修正建模为摊销变分推断问题,并在元学习框架下推导证据下界。具体地,VRI通过将修正向量设为隐变量构建层次贝叶斯模型,引入额外随机性正则化,增强对标签噪声的鲁棒性。为实现修正向量的推断,使用摊销元网络近似其条件后验分布。通过引入变分项,后验估计更准确,避免退化为狄拉克δ函数,显著提升泛化性能。精心设计的元网络与先验网络符合平滑性假设,生成可靠的修正向量。在一组干净元数据上,可高效完成双层优化下的元学习。理论分析表明,该算法能有效学习元网络。大量对比实验与分析验证了其在噪声标签学习中的有效性,尤其在开放集噪声场景表现突出。

原文摘要 · Abstract (English)

Label noise has been broadly observed in real-world datasets. To mitigate the negative impact of overfitting to label noise for deep models, effective strategies (\textit{e.g.}, re-weighting, or loss rectification) have been broadly applied in prevailing approaches, which have been generally learned under the meta-learning scenario. Despite the robustness of noise achieved by the probabilistic meta-learning models, they usually suffer from model collapse that degenerates generalization performance. In this paper, we propose variational rectification inference (VRI) to formulate the adaptive rectification for loss functions as an amortized variational inference problem and derive the evidence lower bound under the meta-learning framework. Specifically, VRI is constructed as a hierarchical Bayes by treating the rectifying vector as a latent variable, which can rectify the loss of the noisy sample with the extra randomness regularization and is, therefore, more robust to label noise. To achieve the inference of the rectifying vector, we approximate its conditional posterior with an amortization meta-network. By introducing the variational term in VRI, the conditional posterior is estimated accurately and avoids collapsing to a Dirac delta function, which can significantly improve the generalization performance. The elaborated meta-network and prior network adhere to the smoothness assumption, enabling the generation of reliable rectification vectors. Given a set of clean meta-data, VRI can be efficiently meta-learned within the bi-level optimization programming. Besides, theoretical analysis guarantees that the meta-network can be efficiently learned with our algorithm. Comprehensive comparison experiments and analyses validate its effectiveness for robust learning with noisy labels, particularly in the presence of open-set noise.

噪声标签元学习变分推断鲁棒训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。