arXiv:2502.20619eess.IVcs.CV2025-02被引 2

通过分离图像风格与内容,提升医学影像分割的跨域泛化能力。

Style Content Decomposition-based Data Augmentation for Domain Generalizable Medical Image Segmentation

  • 将图像分解为风格码和内容图,分别建模全局光照与局部结构差异。
  • 在心磁共振与眼底照片任务中,跨域性能显著优于现有方法。
  • 无需额外参数或修改架构,可直接嵌入现有模型使用。

由于不同医学成像模态间的域偏移,训练好的分割模型在部署时性能常大幅下降。我们认为这些域偏移主要由两类成分构成:1)'风格'偏移,指光照、对比度、色彩等全局图像属性的差异;2)'内容'偏移,涉及解剖结构的局部不一致。为此,我们首先将图像分解为风格码和内容图,显式建模风格与内容成分。在此基础上,提出一种基于风格-内容分解的数据增强算法(StyCona),对源域图像的全局风格和局部内容进行增强,从而训练出具有强泛化能力的医学图像分割模型。StyCona 是一个简单高效的即插即用模块,显著提升模型泛化能力,且无需增加训练参数或修改分割模型结构。在心脏磁共振成像与眼底照片分割任务上,分别针对单个和多个目标域的实验验证了其有效性,性能优于当前最先进的域泛化方法。代码已开源:https://github.com/Senyh/StyCona。

原文摘要 · Abstract (English)

Due to domain shifts across diverse medical imaging modalities, learned segmentation models often suffer significant performance degradation during deployment. We posit that these domain shifts can generally be categorized into two main components: 1) "style" shifts, referring to global disparities in image properties such as illumination, contrast, and color; and 2) "content" shifts, which involve local discrepancies in anatomical structures. To address the domain shifts in medical image segmentation, we first factorize an image into style codes and content maps, explicitly modeling the "style" and "content" components. Building on this, we introduce a Style-Content decomposition-based data augmentation algorithm (StyCona), which performs augmentation on both the global style and local content of source-domain images, enabling the training of a well-generalized model for domain generalizable medical image segmentation. StyCona is a simple yet effective plug-and-play module that substantially improves model generalization without requiring additional training parameters or modifications to segmentation model architectures. Experiments on cardiac magnetic resonance imaging and fundus photography segmentation tasks, with single and multiple target domains respectively, demonstrate the effectiveness of StyCona and its superiority over state-of-the-art domain generalization methods. The code is available at https://github.com/Senyh/StyCona.

医学图像域泛化数据增强分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。