arXiv:2411.01613cs.CV2024-11中稿 · Pattern Recognitio…被引 17

提出ANNE方法,融合多种样本筛选策略,提升噪声标签学习在不同噪声率下的鲁棒性。

ANNE: Adaptive Nearest Neighbors and Eigenvector-based Sample Selection for Robust Learning with Noisy Labels

  • 根据损失值分组后,低损失组用特征向量法、高损失组用自适应K近邻法筛选
  • 在CIFAR-10/100、Webvision等数据集上优于现有SOTA方法,噪声率覆盖广
  • 适合各类噪声场景,尤其对高低噪声混合情况表现稳健

当前主流噪声标签学习方法通常包含样本选择阶段,将训练集分为噪声样本和干净样本。常见策略有两种:基于损失的采样(高损失样本视为噪声)和基于特征的采样(同类样本在特征空间聚集,异常点为噪声)。经验表明,基于损失的方法对各种噪声率均较鲁棒,而基于特征的方法在特定场景更优,例如低噪声率下通过特征向量筛选(FINE)效果好,高噪声率下自适应K近邻(Adaptive KNN)表现更佳。本文提出自适应最近邻与特征向量结合的样本选择方法(ANNE),先按损失值将训练集划分为高损失和低损失子集,再在低损失子集使用FINE,在高损失子集采用Adaptive KNN进行选择。将ANNE集成至噪声标签学习SOTA方法SSR+,在带有对称、异构及实例相关噪声的CIFAR-10/-100,以及Webvision和ANIMAL-10数据集上测试,多数实验中性能超越现有SOTA,且训练时间具有竞争力。

原文摘要 · Abstract (English)

An important stage of most state-of-the-art (SOTA) noisy-label learning methods consists of a sample selection procedure that classifies samples from the noisy-label training set into noisy-label or clean-label subsets. The process of sample selection typically consists of one of the two approaches: loss-based sampling, where high-loss samples are considered to have noisy labels, or feature-based sampling, where samples from the same class tend to cluster together in the feature space and noisy-label samples are identified as anomalies within those clusters. Empirically, loss-based sampling is robust to a wide range of noise rates, while feature-based sampling tends to work effectively in particular scenarios, e.g., the filtering of noisy instances via their eigenvectors (FINE) sampling exhibits greater robustness in scenarios with low noise rates, and the K nearest neighbor (KNN) sampling mitigates better high noise-rate problems. This paper introduces the Adaptive Nearest Neighbors and Eigenvector-based (ANNE) sample selection methodology, a novel approach that integrates loss-based sampling with the feature-based sampling methods FINE and Adaptive KNN to optimize performance across a wide range of noise rate scenarios. ANNE achieves this integration by first partitioning the training set into high-loss and low-loss sub-groups using loss-based sampling. Subsequently, within the low-loss subset, sample selection is performed using FINE, while the high-loss subset employs Adaptive KNN for effective sample selection. We integrate ANNE into the noisy-label learning state of the art (SOTA) method SSR+, and test it on CIFAR-10/-100 (with symmetric, asymmetric and instance-dependent noise), Webvision and ANIMAL-10, where our method shows better accuracy than the SOTA in most experiments, with a competitive training time.

噪声标签样本选择分类深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。