arXiv:2503.19589eess.IVcs.CV2025-03被引 2

用提示引导的双路径网络融合卷积与Mamba,提升医学图像分割精度。

Prompt-Guided Dual-Path UNet with Mamba for Medical Image Segmentation

  • 设计双路径结构,分别处理局部细节和全局依赖。
  • 在ISIC-2017等4个数据集上分割效果优于现有方法。
  • 适合需要高精度分割的医学影像分析场景。

卷积神经网络(CNN)和变压器广泛用于构建用于医学图像分割的UNet架构。然而,CNN难以建模长距离依赖,而变压器存在二次计算复杂性问题。最近,状态空间模型Mamba因其在保持线性计算复杂度的同时出色建模长距离交互的能力而受到关注。尽管已有多种基于Mamba的方法出现,但仍存在以下局限:首先,其网络设计通常缺乏对原始输入数据的感知能力;其次,主要关注捕获全局信息,常忽视局部细节。为解决这些问题,我们提出一种提示引导的CNN-Mamba双路径UNet,称为PGM-UNet。具体而言,引入提示引导的残差Mamba模块,从原始输入数据中自适应提取动态视觉提示,有效引导Mamba捕捉全局信息。此外,设计局部-全局信息融合网络,包含局部信息提取模块、提示引导的残差Mamba模块和多焦点注意力融合模块,有效整合局部与全局信息。进一步受柯尔莫哥洛夫-阿诺德网络(KANs)启发,开发多尺度信息提取模块,在不改变分辨率的情况下捕获更丰富的上下文信息。我们在ISIC-2017、ISIC-2018、DIAS和DRIVE数据集上进行了大量实验。结果表明,所提方法在多个医学图像分割任务中显著优于当前最优方法。

原文摘要 · Abstract (English)

Convolutional neural networks (CNNs) and transformers are widely employed in constructing UNet architectures for medical image segmentation tasks. However, CNNs struggle to model long-range dependencies, while transformers suffer from quadratic computational complexity. Recently, Mamba, a type of State Space Models, has gained attention for its exceptional ability to model long-range interactions while maintaining linear computational complexity. Despite the emergence of several Mamba-based methods, they still present the following limitations: first, their network designs generally lack perceptual capabilities for the original input data; second, they primarily focus on capturing global information, while often neglecting local details. To address these challenges, we propose a prompt-guided CNN-Mamba dual-path UNet, termed PGM-UNet, for medical image segmentation. Specifically, we introduce a prompt-guided residual Mamba module that adaptively extracts dynamic visual prompts from the original input data, effectively guiding Mamba in capturing global information. Additionally, we design a local-global information fusion network, comprising a local information extraction module, a prompt-guided residual Mamba module, and a multi-focus attention fusion module, which effectively integrates local and global information. Furthermore, inspired by Kolmogorov-Arnold Networks (KANs), we develop a multi-scale information extraction module to capture richer contextual information without altering the resolution. We conduct extensive experiments on the ISIC-2017, ISIC-2018, DIAS, and DRIVE. The results demonstrate that the proposed method significantly outperforms state-of-the-art approaches in multiple medical image segmentation tasks.

医学图像分割Mamba双路径

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。