通过虚拟异常样本重构特征空间,提升噪声标签下的模型鲁棒性
GAMR: Geometric-Aware Manifold Regularization with Virtual Outlier Synthesis for Learning with Noisy Labels

- 主动合成虚拟异常点,构建数据流形间的能量壁垒
- 在CIFAR-10上超越现有SOTA方法,尤其在非对称噪声下优势明显
- 无需预设噪声模式,可嵌入现有框架,适合开放世界应用
深度神经网络在处理噪声标签时性能显著下降,主要源于对错误标签的过拟合。当前主流方法多通过被动过滤训练中的干净样本缓解此问题,但在被噪声污染的特征空间中,难以区分困难样本与噪声样本,形成性能瓶颈。本文首次强调主动重塑特征空间几何结构的重要性,提出几何感知流形正则化范式(GAMR),核心思想是通过主动合成虚拟异常样本,在数据流形间显式构建能量屏障。该机制通过施加促进类内紧凑、类间分离的几何约束,增强困难样本与噪声样本的可区分性,从而学习更鲁棒的表示。该正则化机制具有高度通用性,其有效性不依赖任何噪声模式假设,可作为独立模块集成至现有样本选择框架中,显著提升对多种噪声环境的鲁棒性。实验表明,该范式在多个基准测试中表现优于当前SOTA方法,包括CIFAR-10,尤其在更具挑战性的非对称噪声条件下优势显著。此外,该范式显著提升了模型在分布外(OOD)检测能力,确保在开放世界场景部署中的更高可靠性和安全性。
原文摘要 · Abstract (English)
Deep neural networks (DNNs) experience significant performance degradation when processing noisy labels, primarily due to overfitting on mislabeled data. Current mainstream approaches attempt to mitigate this issue by passively filtering clean samples during training. However, simple sample filtering within feature spaces degraded by noise struggles to distinguish between challenging samples and noisy samples, creating a bottleneck for model performance. We highlight for the first time the fundamental importance of actively reshaping feature space geometry for learning from noisy data. We propose a novel Geometry-aware Manifold Regularization Paradigm whose core idea is to explicitly construct energy barriers between data manifolds by actively synthesizing virtual outlier samples. By imposing geometric constraints that promote intra-class compactness and inter-class separation, this approach enhances the discriminability between hard and noisy samples, leading to the learning of more robust representations. Our regularization mechanism exhibits high universality, with effectiveness independent of any prior assumptions about noise patterns. It can be integrated as a standalone mechanism into existing sample selection frameworks, providing stronger robustness against diverse noisy environments. Experiments demonstrate that our paradigm achieves performance surpassing current state-of-the-art (SOTA) methods on multiple benchmarks, including CIFAR-10, with particularly pronounced advantages under more challenging asymmetric noise conditions. Furthermore, this paradigm significantly enhances the model's capability in Out-of-Distribution (OOD) detection, ensuring superior reliability and safety for deployment in open-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。