提出一种自适应加权损失,提升医学图像分割的半监督学习效果。
MetaSSL: A General Heterogeneous Loss for Semi-Supervised Medical Image Segmentation
- 基于预测一致性与置信度,为不同像素分配动态权重。
- 在多个数据集上显著提升现有半监督方法的分割精度。
- 适用于各类半监督框架,对标注噪声具有鲁棒性。
半监督学习(SSL)对于降低医学图像分割模型的标注成本至关重要。当前主流方法如Mean Teacher、FixMatch和交叉伪标签(CPS)主要依赖参考预测与监督预测间的一致性正则化或伪标签监督。然而,这些方法忽略了标注数据中的潜在噪声,且过度关注如何生成参考预测,而忽视了未标注像素间的异质性。本文认为,更关键的是在损失函数中有效挖掘两个预测所包含的丰富信息,而非具体生成参考预测的策略。为此,提出通用框架MetaSSL,采用空间异质性损失,通过同时利用参考预测与监督预测间的不确定性与一致性信息,为像素分配不同权重。具体地,将未标注数据的预测划分为四个区域:一致且可信(UC)、一致但可疑(US)、不一致且可信(DC)、不一致且可疑(DS),并引入自适应阈值区分可信与可疑预测。该异质性损失也应用于标注数据以增强对标注噪声的鲁棒性。本方法可即插即用,适用于大多数现有SSL方法。实验表明,在多个数据集上,其集成现有框架后显著提升了分割性能。代码已开源:https://github.com/HiLab-git/MetaSSL。
原文摘要 · Abstract (English)
Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on consistency regularization or pseudo-label supervision between a reference prediction and a supervised prediction. Despite the effectiveness, they have overlooked the potential noise in the labeled data, and mainly focus on strategies to generate the reference prediction, while ignoring the heterogeneous values of different unlabeled pixels. We argue that effectively mining the rich information contained by the two predictions in the loss function, instead of the specific strategy to obtain a reference prediction, is more essential for SSL, and propose a universal framework MetaSSL based on a spatially heterogeneous loss that assigns different weights to pixels by simultaneously leveraging the uncertainty and consistency information between the reference and supervised predictions. Specifically, we split the predictions on unlabeled data into four regions with decreasing weights in the loss: Unanimous and Confident (UC), Unanimous and Suspicious (US), Discrepant and Confident (DC), and Discrepant and Suspicious (DS), where an adaptive threshold is proposed to distinguish confident predictions from suspicious ones. The heterogeneous loss is also applied to labeled images for robust learning considering the potential annotation noise. Our method is plug-and-play and general to most existing SSL methods. The experimental results showed that it improved the segmentation performance significantly when integrated with existing SSL frameworks on different datasets. Code is available at https://github.com/HiLab-git/MetaSSL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。