arXiv:2412.00150cs.CVeess.IV2024-12NeurIPS被引 9

利用预训练模型特征,分阶段筛选干净样本提升医疗图像分类抗噪能力。

Curriculum Fine-tuning of Vision Foundation Model for Medical Image Classification Under Label Noise

  • 先用线性探测识别干净样本,再逐步微调适配器
  • 在40%噪声下多个数据集性能提升4.6%~5.8%
  • 适合医疗图像中标签不洁场景的模型优化

深度神经网络在各类视觉任务中表现优异,但其性能高度依赖训练数据质量。医学数据集中存在噪声标签是关键问题,会显著降低模型表现。以往的干净样本选择方法未利用视觉基础模型(VFMs)的良好预训练特征,且假设训练从零开始。本文提出CUFIT,一种面向噪声标签下医疗图像分类的视觉基础模型课程微调范式。该方法基于线性探测对噪声样本相对鲁棒的特性——因不更新VFM特征提取器,可稳定分类训练样本。随后,从线性探测阶段选出的清洁样本出发,对两个适配器进行课程微调。实验表明,CUFIT在多个医学图像基准上优于先前方法:在40%噪声率下,于HAM10000、APTOS-2019、BloodMnist和OrgancMnist数据集分别超越基线5.0%、2.1%、4.6%和5.8%。此外,我们通过大量分析验证了该方法在噪声标签检测上的优势,如更高精度与召回率。本工作凸显了在标签噪声挑战下利用视觉基础模型的潜力。

原文摘要 · Abstract (English)

Deep neural networks have demonstrated remarkable performance in various vision tasks, but their success heavily depends on the quality of the training data. Noisy labels are a critical issue in medical datasets and can significantly degrade model performance. Previous clean sample selection methods have not utilized the well pre-trained features of vision foundation models (VFMs) and assumed that training begins from scratch. In this paper, we propose CUFIT, a curriculum fine-tuning paradigm of VFMs for medical image classification under label noise. Our method is motivated by the fact that linear probing of VFMs is relatively unaffected by noisy samples, as it does not update the feature extractor of the VFM, thus robustly classifying the training samples. Subsequently, curriculum fine-tuning of two adapters is conducted, starting with clean sample selection from the linear probing phase. Our experimental results demonstrate that CUFIT outperforms previous methods across various medical image benchmarks. Specifically, our method surpasses previous baselines by 5.0%, 2.1%, 4.6%, and 5.8% at a 40% noise rate on the HAM10000, APTOS-2019, BloodMnist, and OrgancMnist datasets, respectively. Furthermore, we provide extensive analyses to demonstrate the impact of our method on noisy label detection. For instance, our method shows higher label precision and recall compared to previous approaches. Our work highlights the potential of leveraging VFMs in medical image classification under challenging conditions of noisy labels.

医疗图像噪声标签微调视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。