通过自洽与邻域一致,有效识别并处理标签噪声数据。
Combating Noisy Labels through Fostering Self- and Neighbor-Consistency
- 用邻近样本增强判断,结合JS散度筛选干净样本
- 对噪声样本分别采用部分标签和负学习策略训练
- 适合存在标签噪声的图像分类任务,提升模型鲁棒性
标签噪声在真实场景中普遍存在,给监督学习带来挑战。深度网络易受标签错误样本影响,因记忆效应而过拟合。现有方法多聚焦于清洗干净数据,但常忽略不同小批量间标签噪声分布不均的问题,且对分布外噪声关注不足。为此,我们提出一种抗噪声方法Jo-SNC(基于自洽与邻域一致的联合样本选择与模型正则化)。通过Jensen-Shannon散度衡量样本为干净或分布外的概率,并利用其最近邻信息提升判断可靠性。设计自适应、数据驱动的类别级阈值机制。对清洁样本进行常规训练;检测到的分布内噪声样本按部分标签学习方式训练,分布外噪声样本则采用负学习策略。进一步引入三元组一致性正则化,强化自预测、邻域预测与特征一致性。在多个基准数据集上的广泛实验及详尽消融研究验证了该方法优于现有最先进方法。
原文摘要 · Abstract (English)
Label noise is pervasive in various real-world scenarios, posing challenges in supervised deep learning. Deep networks are vulnerable to such label-corrupted samples due to the memorization effect. One major stream of previous methods concentrates on identifying clean data for training. However, these methods often neglect imbalances in label noise across different mini-batches and devote insufficient attention to out-of-distribution noisy data. To this end, we propose a noise-robust method named Jo-SNC (\textbf{Jo}int sample selection and model regularization based on \textbf{S}elf- and \textbf{N}eighbor-\textbf{C}onsistency). Specifically, we propose to employ the Jensen-Shannon divergence to measure the ``likelihood'' of a sample being clean or out-of-distribution. This process factors in the nearest neighbors of each sample to reinforce the reliability of clean sample identification. We design a self-adaptive, data-driven thresholding scheme to adjust per-class selection thresholds. While clean samples undergo conventional training, detected in-distribution and out-of-distribution noisy samples are trained following partial label learning and negative learning, respectively. Finally, we advance the model performance further by proposing a triplet consistency regularization that promotes self-prediction consistency, neighbor-prediction consistency, and feature consistency. Extensive experiments on various benchmark datasets and comprehensive ablation studies demonstrate the effectiveness and superiority of our approach over existing state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。