用扩散模型同时生成图像和掩码,提升医学图像分割的泛化能力。
DiffAtlas: GenAI-fying Atlas Segmentation via Image-Mask Diffusion
- 训练时联合建模图像与掩码的扩散过程,打破传统图像到掩码映射
- 在少量数据和跨模态场景下表现优于现有方法,零样本分割效果显著
- 适合需要高鲁棒性、低数据依赖的医学图像分割任务
精准的医学图像分割对解剖结构界定至关重要。尽管U-Net等深度学习模型表现优异,但仍依赖大规模数据,在领域偏移、复杂结构及小样本场景下表现不佳。近期研究尝试通过迭代优化掩码来应用扩散模型进行分割,但这些方法仍沿用传统的图像到掩码映射,对输入敏感,影响稳定性和泛化性。本文提出DiffAtlas,一种新型生成框架,在训练中通过扩散模型联合建模图像与掩码,真正实现“生成式AI赋能”的基于图谱的分割。测试时,模型被引导生成特定的目标图像-掩码对,从中提取对应掩码。该方法保持了图谱范式的鲁棒性,同时克服了其可扩展性与领域特异性限制。在MMWHS与TotalSegmentator数据集上,针对同一域、跨模态、不同域及不同数据规模设置的大量实验表明,该方法在小样本和零样本模态分割场景下显著优于现有技术。代码已开源。
原文摘要 · Abstract (English)
Accurate medical image segmentation is crucial for precise anatomical delineation. Deep learning models like U-Net have shown great success but depend heavily on large datasets and struggle with domain shifts, complex structures, and limited training samples. Recent studies have explored diffusion models for segmentation by iteratively refining masks. However, these methods still retain the conventional image-to-mask mapping, making them highly sensitive to input data, which hampers stability and generalization. In contrast, we introduce DiffAtlas, a novel generative framework that models both images and masks through diffusion during training, effectively ``GenAI-fying'' atlas-based segmentation. During testing, the model is guided to generate a specific target image-mask pair, from which the corresponding mask is obtained. DiffAtlas retains the robustness of the atlas paradigm while overcoming its scalability and domain-specific limitations. Extensive experiments on CT and MRI across same-domain, cross-modality, varying-domain, and different data-scale settings using the MMWHS and TotalSegmentator datasets demonstrate that our approach outperforms existing methods, particularly in limited-data and zero-shot modality segmentation. Code is available at https://github.com/M3DV/DiffAtlas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。