利用因果机制与扩散增广,提升医学图像跨模态分割的泛化能力。
Generalizable Single-Source Cross-modality Medical Image Segmentation via Invariant Causal Mechanisms
- 基于因果干预与扩散模型生成风格不变的医学图像数据。
- 在三个解剖部位、多种成像模态上均超越现有最先进方法。
- 适合医疗影像领域需跨设备/模态部署的模型开发者使用。
单源域泛化(SDG)旨在仅从单一源域训练模型,使其在未见目标域上具有良好泛化性能,是计算机视觉中重要任务,尤其适用于存在常见域偏移的医学影像领域。本文研究更具挑战性且实际的跨模态医学图像分割中的单源域泛化问题。结合因果启发的领域不变表征学习理论与基于扩散模型的增强技术,提出新方法。依据“干预-增广等变”原则,采用受控扩散模型(DMs)模拟多样成像风格,同时保留内容信息,利用大规模预训练扩散模型中的丰富生成先验,全面扰动多维风格变量。在具有挑战性的跨模态分割任务上进行大量实验,结果表明,该方法在三个不同解剖部位和多种成像模态下均持续优于当前最先进的SDG方法。源代码已公开于 https://github.com/ratschlab/ICMSeg。
原文摘要 · Abstract (English)
Single-source domain generalization (SDG) aims to learn a model from a single source domain that can generalize well on unseen target domains. This is an important task in computer vision, particularly relevant to medical imaging where domain shifts are common. In this work, we consider a challenging yet practical setting: SDG for cross-modality medical image segmentation. We combine causality-inspired theoretical insights on learning domain-invariant representations with recent advancements in diffusion-based augmentation to improve generalization across diverse imaging modalities. Guided by the ``intervention-augmentation equivariant'' principle, we use controlled diffusion models (DMs) to simulate diverse imaging styles while preserving the content, leveraging rich generative priors in large-scale pretrained DMs to comprehensively perturb the multidimensional style variable. Extensive experiments on challenging cross-modality segmentation tasks demonstrate that our approach consistently outperforms state-of-the-art SDG methods across three distinct anatomies and imaging modalities. The source code is available at \href{https://github.com/ratschlab/ICMSeg}{https://github.com/ratschlab/ICMSeg}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。