arXiv:2505.11909eess.IVcs.CV2025-05被引 2

利用边缘特征桥接跨模态医学图像分割的域间差异

Bridging the Inter-Domain Gap through Low-Level Features for Cross-Modal Medical Image Segmentation

  • 通过生成模型从边缘特征还原源域图像,实现跨模态特征对齐
  • 在多个公开数据集上超越11种现有方法,达当前最优性能
  • 兼容多种生成与分割模型,适配先进架构提升效果

本文针对跨模态医学图像分割问题,探索无监督域自适应(UDA)方法。提出一个模型无关的UDA框架LowBridge,基于跨模态图像因描绘相同结构而共享部分低层特征(如边缘)的观察。首先,训练生成模型从边缘特征还原源域图像;随后,在生成的源域图像上训练分割模型。测试时,将目标域图像的边缘特征输入预训练生成模型,生成源域风格图像,再由预训练分割网络进行分割。尽管方法简单,但在多个公开数据集上的大量实验表明,该方法在不同设置下均达到当前最优性能,超越11种现有UDA方法。进一步消融实验显示,该方法对生成与分割模型类型不敏感,具备无缝集成最先进模型的潜力,未来有望实现更优结果。代码已开源:https://github.com/JoshuaLPF/LowBridge。

原文摘要 · Abstract (English)

This paper addresses the task of cross-modal medical image segmentation by exploring unsupervised domain adaptation (UDA) approaches. We propose a model-agnostic UDA framework, LowBridge, which builds on a simple observation that cross-modal images share some similar low-level features (e.g., edges) as they are depicting the same structures. Specifically, we first train a generative model to recover the source images from their edge features, followed by training a segmentation model on the generated source images, separately. At test time, edge features from the target images are input to the pretrained generative model to generate source-style target domain images, which are then segmented using the pretrained segmentation network. Despite its simplicity, extensive experiments on various publicly available datasets demonstrate that \proposed achieves state-of-the-art performance, outperforming eleven existing UDA approaches under different settings. Notably, further ablation studies show that \proposed is agnostic to different types of generative and segmentation models, suggesting its potential to be seamlessly plugged with the most advanced models to achieve even more outstanding results in the future. The code is available at https://github.com/JoshuaLPF/LowBridge.

医学图像跨模态无监督学习图像分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。