通过解耦结构与外观特征,提升医学图像分割的可靠性。
SAUF-Net: Structure--Appearance Representation Learning with Uncertainty Feedback for Semi-Supervised Medical Image Segmentation

- 解耦结构与外观特征,分离瓶颈层表示
- 在低标注数据下准确率超现有方法,尤其在10%标签时提升显著
- 适合标注稀缺的医学图像分割任务
半监督学习在降低医学图像分割标注成本方面展现出巨大潜力。然而,现有方法多依赖预测层面的一致性来利用无标签数据,忽视了内部特征表示的可靠性。在医学图像中,目标相关结构线索常与不稳定的外观变化混淆,导致伪标签不可靠,并引发训练过程中的误差累积。为此,本文提出SAUF-Net,一种基于不确定性反馈的结构-外观表征学习网络。该方法通过结构-外观分解模块(SADM)将瓶颈特征解耦为结构与外观表征,并通过解耦引导模块(DGM)将其注入解码过程以增强结构感知分割。辅助解码器生成分支级预测用于可靠性估计,并输出融合预测以实现外观交换一致性。此外,引入外观交换一致性分支,促使结构表征在外观变化下保持稳定。还设计了基于可靠性图的双头判别器,包含有效性头和不确定性头,提供特征级别的不确定性反馈。在ISIC-2016和Kvasir-SEG数据集上的大量实验表明,SAUF-Net在低标签设置下优于现有先进方法。
原文摘要 · Abstract (English)
Semi-supervised learning has shown great potential for reducing annotation costs in medical image segmentation. However, most existing methods mainly exploit unlabeled data through prediction-level consistency, while the reliability of internal feature representations is often overlooked. In medical images, target-related structural cues are easily entangled with unstable appearance variations, which may lead to unreliable pseudo labels and error accumulation during training. To address these issues, we propose SAUF-Net, a Structure--Appearance Representation Learning with Uncertainty Feedback Network for semi-supervised medical image segmentation. SAUF-Net uses the Structure--Appearance Decomposition Module (SADM) to separate bottleneck features into structural and appearance representations. The Disentangled Guidance Module (DGM) injects these representations into the decoding process to enhance structure-aware segmentation. Meanwhile, the Auxiliary Decoder produces branch-specific predictions for reliability estimation and a fused prediction for appearance-swapped consistency. Furthermore, we introduce an Appearance-Swapped Consistency branch to encourage structural representations to remain stable under appearance variations. We also introduce a reliability-map-guided dual-head discriminator with a Validity Head and an Uncertainty Head to provide feature-level uncertainty feedback. Extensive experiments on ISIC-2016 and Kvasir-SEG demonstrate that SAUF-Net outperforms state-of-the-art semi-supervised methods, especially under low-label settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。