用扩散模型与卷积网络协作,提升医学图像分割的准确性。
Diff-CL: A Novel Cross Pseudo-Supervision Method for Semi-supervised Medical Image Segmentation
- 用扩散模型学数据分布,卷积网络补细节,协同提升分割效果。
- 在三个医学数据集上达到当前最好性能,左心房、脑肿瘤和胰腺数据集均领先。
- 适合需要少标注数据却高精度分割的研究者,尤其关注医学影像分析。
半监督学习通过利用未标注数据提升模型泛化能力,减少对大规模标注数据的依赖。现有方法多聚焦于有限样本,难以捕捉整体数据分布。本文认为,结合分布信息与细节信息对实现更鲁棒、精准的分割至关重要。一方面,扩散模型(DM)具备强大生成能力,能有效学习数据分布,但难以捕捉精细细节,生成图像易含误导性细节;而卷积神经网络(CNN)虽可捕获高频细节,但需大量计算资源且易受局部噪声干扰。为此,我们提出一种基于分布视角的半监督医学图像分割框架(Diff-CL)。首先,设计扩散模型与卷积分割网络间的跨伪监督机制;其次,引入高频率马尔可夫模块(Mamba)全局捕捉边界与细节信息;最后,采用对比学习实现从标注数据到未标注数据的标签传播。实验在左心房、脑肿瘤及NIH胰腺数据集上验证,本方法取得当前最优(SOTA)表现。
原文摘要 · Abstract (English)
Semi-supervised learning utilizes insights from unlabeled data to improve model generalization, thereby reducing reliance on large labeled datasets. Most existing studies focus on limited samples and fail to capture the overall data distribution. We contend that combining distributional information with detailed information is crucial for achieving more robust and accurate segmentation results. On the one hand, with its robust generative capabilities, diffusion models (DM) learn data distribution effectively. However, it struggles with fine detail capture, leading to generated images with misleading details. Combining DM with convolutional neural networks (CNNs) enables the former to learn data distribution while the latter corrects fine details. While capturing complete high-frequency details by CNNs requires substantial computational resources and is susceptible to local noise. On the other hand, given that both labeled and unlabeled data come from the same distribution, we believe that regions in unlabeled data similar to overall class semantics to labeled data are likely to belong to the same class, while regions with minimal similarity are less likely to. This work introduces a semi-supervised medical image segmentation framework from the distribution perspective (Diff-CL). Firstly, we propose a cross-pseudo-supervision learning mechanism between diffusion and convolution segmentation networks. Secondly, we design a high-frequency mamba module to capture boundary and detail information globally. Finally, we apply contrastive learning for label propagation from labeled to unlabeled data. Our method achieves state-of-the-art (SOTA) performance across three datasets, including left atrium, brain tumor, and NIH pancreas datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。