提出排水节点统一处理标签噪声与分布外样本,提升模型鲁棒性。
Drainage: A Unifying Framework for Addressing Class Uncertainty
- 在输出层引入排水节点,将不确定样本的概率质量重新分配。
- 在高噪声下准确率最高提升9%,优于现有方法。
- 适用于数据清洗、开放集识别等场景,适合工业级应用。
现代深度学习面临标签噪声、类别模糊以及对分布外或损坏样本的稳健拒绝等挑战。本文提出一种基于‘排水节点’的统一框架,该节点被添加在网络输出端,可将概率质量导向不确定性区域,同时保持端到端训练和可微性。该机制为高度模糊、异常或噪声样本提供自然逃逸路径,尤其适用于实例相关和非对称标签噪声。在对CIFAR-10/100标签添加不同比例的实例相关噪声或非对称噪声的系统实验中,本方法在高噪声环境下相较现有方法准确率最高提升9%。在mini-WebVision、mini-ImageNet和Clothing-1M等真实数据集上,结果达到或超越当前最优水平。定性分析显示,排水节点具有去噪效果,能持续吸收错误标注、误标或离群数据,使决策边界更稳定。此外,该框架可拓展至分类之外,对网络规模数据清洗、半监督学习及开放集识别有直接价值。
原文摘要 · Abstract (English)
Modern deep learning faces significant challenges with noisy labels, class ambiguity, as well as the need to robustly reject out-of-distribution or corrupted samples. In this work, we propose a unified framework based on the concept of a "drainage node'' which we add at the output of the network. The node serves to reallocate probability mass toward uncertainty, while preserving desirable properties such as end-to-end training and differentiability. This mechanism provides a natural escape route for highly ambiguous, anomalous, or noisy samples, particularly relevant for instance-dependent and asymmetric label noise. In systematic experiments involving the addition of varying proportions of instance-dependent noise or asymmetric noise to CIFAR-10/100 labels, our drainage formulation achieves an accuracy increase of up to 9\% over existing approaches in the high-noise regime. Our results on real-world datasets, such as mini-WebVision, mini-ImageNet and Clothing-1M, match or surpass existing state-of-the-art methods. Qualitative analysis reveals a denoising effect, where the drainage neuron consistently absorbs corrupt, mislabeled, or outlier data, leading to more stable decision boundaries. Furthermore, our drainage formulation enables applications well beyond classification, with immediate benefits for web-scale, semi-supervised dataset cleaning, and open-set applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。