arXiv:2410.04648cs.CV2024-10被引 7

无需标注,让眼底图像模型跨模态分割视网膜血管

AdaptDiff: Cross-Modality Domain Adaptation via Weak Conditional Semantic Diffusion for Retinal Vessel Segmentation

  • 用伪标签训练扩散模型建模目标域语义分布
  • 生成带血管图的合成图像,提升跨模态分割精度
  • 适合无标注数据的医学图像跨模态迁移场景

深度学习在医学图像分割中表现优异,但因数据分布差异和缺乏标注,难以迁移到未见领域。为此,我们提出无监督域适应方法AdaptDiff,使基于眼底照相(FP)训练的视网膜血管分割模型,能在未见模态(如OCT-A)上取得良好效果,无需人工标注。首先用源域模型生成目标域伪标签,再训练条件语义扩散模型以捕捉目标域分布。即使伪标签质量较低,扩散模型仍能有效提取条件语义信息。随后,利用源域二值血管图作为条件,在目标域采样生成配对合成图像。最后,使用这些合成数据微调预训练分割网络,缓解域间差异。我们在三个不同模态的七个公开数据集上验证了AdaptDiff的有效性,所有未见数据集均显著提升分割性能。代码已开源:https://github.com/DeweiHu/AdaptDiff。

原文摘要 · Abstract (English)

Deep learning has shown remarkable performance in medical image segmentation. However, despite its promise, deep learning has many challenges in practice due to its inability to effectively transition to unseen domains, caused by the inherent data distribution shift and the lack of manual annotations to guide domain adaptation. To tackle this problem, we present an unsupervised domain adaptation (UDA) method named AdaptDiff that enables a retinal vessel segmentation network trained on fundus photography (FP) to produce satisfactory results on unseen modalities (e.g., OCT-A) without any manual labels. For all our target domains, we first adopt a segmentation model trained on the source domain to create pseudo-labels. With these pseudo-labels, we train a conditional semantic diffusion probabilistic model to represent the target domain distribution. Experimentally, we show that even with low quality pseudo-labels, the diffusion model can still capture the conditional semantic information. Subsequently, we sample on the target domain with binary vessel masks from the source domain to get paired data, i.e., target domain synthetic images conditioned on the binary vessel map. Finally, we fine-tune the pre-trained segmentation network using the synthetic paired data to mitigate the domain gap. We assess the effectiveness of AdaptDiff on seven publicly available datasets across three distinct modalities. Our results demonstrate a significant improvement in segmentation performance across all unseen datasets. Our code is publicly available at https://github.com/DeweiHu/AdaptDiff.

医学图像域适应扩散模型血管分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。