轻量级噪声修正方法,自动区分干净/错误标签并修复
LiNC: Lightweight Noise Correction via Per-Sample Trust and Gaussian Mixture Modeling

- 为每样本添加可学习信任度,动态融合真实标签与模型预测
- 在50%标签噪声下,10个医学图像数据集均提升准确率
- 适合医疗影像训练,对计算资源几乎无额外负担
医学影像数据常因标注者差异、误标或模糊病例存在标签噪声,严重影响模型可靠性。本文提出轻量级噪声修正方法LiNC,为每个训练样本引入可学习的信任参数,在标准训练中决定何时使用真实标签,何时依赖模型自身预测。核心思想是通过观察标签与模型预测的凸组合优化,早期训练中清洁样本与噪声样本的信任值朝相反方向演化,形成可分离的信任分布。利用三成分高斯混合模型将信任值划分为干净、模糊和噪声三类,随后对噪声样本进行短时软修正和最终硬修正。在包含10个2D医学图像数据集的MedMNISTv2上,标签噪声最高达50%时,仍保持一致的准确率提升,并具备强误标检测能力。LiNC训练开销极低:时间复杂度仍由基础网络主导,内存增长与训练集规模线性相关。
原文摘要 · Abstract (English)
Label noise is common in medical imaging datasets due to factors such as inter-rater variability, annotation errors, and ambiguous cases. This can severely undermine the reliability and clinical effectiveness of machine learning models trained using those datasets. To address this challenge, we introduce Lightweight Noise Correction (LiNC), which adds a single trainable trust parameter per training sample and learns when to use the observed label and when to defer to the model during a standard training loop. The key idea is to train using a convex combination of the observed label and the model's own predictive distribution, controlled by a per-sample trust parameter. We show that the gradient of this objective drives trust values in opposite directions for clean versus noisy samples in the early training phase, yielding separable trust distributions. We use a 3-component Gaussian Mixture Model over the trust values to separate them into clean, ambiguous, and noisy cases and then execute a short soft-correction phase on the noisy cases and a final hard correction phase. Experiments on ten 2D datasets from MedMNISTv2 under label noise of up to 50% show consistent gains in accuracy and strong mislabel detection. LiNC adds negligible asymptotic overhead: the training-time complexity remains dominated by the base network, with additional memory growing linearly with the size of the training set.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。