arXiv:2501.04269cs.CV2025-01被引 10

提出新方法精准区分开放集与封闭集标签噪声,提升模型鲁棒性。

Open set label noise learning with robust sample selection and margin-guided module

  • 通过损失与置信度双重筛选,更全面选出干净样本。
  • 设计边界函数区分开放集与封闭集噪声,准确率显著提升。
  • 适配不同噪声类型动态处理,适合真实世界复杂数据场景。

近年来,深度神经网络在计算机视觉中的成功很大程度上依赖于大规模高质量标注数据集。直接在含标签噪声的真实数据集上训练可能导致过拟合。传统方法仅能处理封闭集标签噪声(即噪声样本的真实类别在已知类别空间内),但许多真实数据集存在开放集标签噪声——部分样本属于未知类别。为此,本文提出基于鲁棒样本选择与边界引导模块(RSS-MGM)的新方法:首先,不同于以往仅筛选少量干净样本,本方法结合小损失与高置信度策略获取更多干净样本;其次,设计边界函数以有效区分开放集与封闭集噪声;最后,针对不同样本类型采用差异化处理策略,充分挖掘数据先验信息并优化整体模型。在多个基准与真实数据集(如CIFAR-100N-C、CIFAR80N-O、WebFG-469、Food101N)上的实验表明,该方法优于众多前沿标签噪声学习方法,尤其在准确划分开放集与封闭集噪声方面表现突出。

原文摘要 · Abstract (English)

In recent years, the remarkable success of deep neural networks (DNNs) in computer vision is largely due to large-scale, high-quality labeled datasets. Training directly on real-world datasets with label noise may result in overfitting. The traditional method is limited to deal with closed set label noise, where noisy training data has true class labels within the known label space. However, there are some real-world datasets containing open set label noise, which means that some samples belong to an unknown class outside the known label space. To address the open set label noise problem, we introduce a method based on Robust Sample Selection and Margin-Guided Module (RSS-MGM). Firstly, unlike the prior clean sample selection approach, which only select a limited number of clean samples, a robust sample selection module combines small loss selection or high-confidence sample selection to obtain more clean samples. Secondly, to efficiently distinguish open set label noise and closed set ones, margin functions are designed to filter open-set data and closed set data. Thirdly, different processing methods are selected for different types of samples in order to fully utilize the data's prior information and optimize the whole model. Furthermore, extensive experimental results with noisy labeled data from benchmark datasets and real-world datasets, such as CIFAR-100N-C, CIFAR80N-O, WebFG-469, and Food101N, indicate that our approach outperforms many state-of-the-art label noise learning methods. Especially, it can more accurately divide open set label noise samples and closed set ones.

标签噪声开放集学习鲁棒训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。