arXiv:2605.17719cs.CV2026-05

提出新型Mamba架构,提升医学图像分割的精度与效率。

Patch-MoE Mamba: A Patch-Ordered Mixture-of-Experts State Space Architecture for Medical Image Segmentation

论文配图:Patch-MoE Mamba: A Patch-Ordered Mixture-of-Experts State Space Architecture for Medical Image Segmentation
图 1 · 摘自论文原文
  • 采用分块有序扫描保留局部空间结构,捕捉多尺度上下文。
  • 引入专家混合机制自适应融合多方向扫描结果,提升分割性能。
  • 在5个结肠息肉和皮肤病变数据集上表现优异,适合医学图像分析。

CNN和Transformer在医学图像分割中表现强劲,但CNN难以建模长距离依赖,Transformer则存在二次计算与内存开销问题。状态空间模型,尤其是基于Mamba的网络,提供了线性序列复杂度的高效替代方案。然而,现有Mamba分割模型仍面临两大局限:像素级方向扫描会破坏局部二维空间结构,而简单的求和融合方式难以适应不同物体大小、形状和边界。为此,我们提出Patch-MoE Mamba,一种用于医学图像分割的分块有序专家混合状态空间架构。该方法引入层次化分块有序扫描机制,在保持局部空间邻近性的同时捕捉多尺度上下文;并设计基于MoE的方向融合模块,通过四个方向专家、一个可学习拼接专家及残差方向聚合,自适应融合多个Mamba扫描器输出。在五个公开结肠息肉分割基准和ISIC 2017/2018皮肤病变分割数据集上的实验表明,Patch-MoE Mamba具有显著的有效性与通用性。

原文摘要 · Abstract (English)

CNN- and Transformer-based architectures have achieved strong performance in medical image segmentation, but CNNs are limited in modeling long-range dependencies, while Transformers often suffer from quadratic computational and memory complexity. State space models, especially Mamba-based networks, offer an efficient alternative with linear sequence complexity. However, existing Mamba segmentation models still face two limitations: pixel-wise directional scanning can disrupt local 2D spatial structure, and simple summation-based fusion of scan directions cannot adapt well to diverse object sizes, shapes, and boundaries. To address these issues, we propose \textit{Patch-MoE Mamba}, a patch-ordered mixture-of-experts state space architecture for medical image segmentation. It introduces a hierarchical patch-ordered scanning mechanism that preserves local spatial neighborhoods while capturing multi-scale context, and an MoE-based directional fusion module that adaptively combines multiple Mamba scanner outputs using four directional experts, a learnable concatenation expert, and residual directional aggregation. Experiments on five public polyp segmentation benchmarks and the ISIC 2017/2018 skin lesion segmentation datasets demonstrate the effectiveness and generality of Patch-MoE Mamba.

医学图像Mamba分割MoE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。