arXiv:2409.03254cs.CVcs.AI2024-09被引 6

用颗粒球表示法提升CNN抗标签噪声能力,无需额外数据或优化。

Granular-ball Representation Learning for Deep CNN on Learning with Label Noise

  • 将输入样本在特征层聚为颗粒球,共享同一标签进行分类
  • 改进梯度分配策略,确保反向传播正常进行
  • 无需数据清洗或额外优化,适合含噪声数据的训练场景

实际场景中,无论人工还是自动标注,训练数据不可避免地存在标签噪声,影响深度CNN模型效果。现有方法需数据清洗或设计额外惩罚机制来应对误标数据,但常导致部分数据丢失。本文提出一种通用的颗粒球计算(GBC)模块,可嵌入CNN模型,使分类器最终预测颗粒球(gb)样本的标签而非单个样本。具体而言:(1) 前向传播时,在特征层面将输入样本划分为颗粒球,每个颗粒球对应多个样本且共享单一标签;(2) 反向传播中改进梯度分配策略,保证信息正常回传;(3) 引入经验回放策略,确保训练过程稳定。实验表明,该方法可在不引入额外数据或优化的前提下,显著提升CNN模型对标签噪声的鲁棒性。

原文摘要 · Abstract (English)

In actual scenarios, whether manually or automatically annotated, label noise is inevitably generated in the training data, which can affect the effectiveness of deep CNN models. The popular solutions require data cleaning or designing additional optimizations to punish the data with mislabeled data, thereby enhancing the robustness of models. However, these methods come at the cost of weakening or even losing some data during the training process. As we know, content is the inherent attribute of an image that does not change with changes in annotations. In this study, we propose a general granular-ball computing (GBC) module that can be embedded into a CNN model, where the classifier finally predicts the label of granular-ball ($gb$) samples instead of each individual samples. Specifically, considering the classification task: (1) in forward process, we split the input samples as $gb$ samples at feature-level, each of which can correspond to multiple samples with varying numbers and share one single label; (2) during the backpropagation process, we modify the gradient allocation strategy of the GBC module to enable it to propagate normally; and (3) we develop an experience replay policy to ensure the stability of the training process. Experiments demonstrate that the proposed method can improve the robustness of CNN models with no additional data or optimization.

CNN标签噪声颗粒球鲁棒学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。