arXiv:2605.11131cs.CV2026-05

提出一种高效医疗图像分割注意力机制,兼顾局部细节与全局信息。

USEMA: a Scalable Efficient Mamba Like Attention for Medical Image Segmentation

论文配图:USEMA: a Scalable Efficient Mamba Like Attention for Medical Image Segmentation
图 1 · 摘自论文原文
  • 结合局部窗口注意力与理论一致的平均算子,避免注意力分散。
  • 在多种模态和尺寸下,计算效率优于纯Transformer模型,分割效果更优。
  • 适合需要高精度与低计算开销的医学图像分析任务。

准确的医学图像分割是医学图像分析流程中的关键环节,需融合局部与全局信息。尽管视觉变换器通过原始自注意力机制可捕捉全局交互,但其输入尺寸呈二次方增长的计算复杂度,仍给医学图像分割带来挑战。受原始自注意力分散特性和Mamba类注意力近期进展启发,本文提出可扩展且高效的Mamba类注意力(SEMA),通过局部窗口注意力实现标记定位,避免注意力分散并保持聚焦,辅以理论一致的算术平均来捕获注意力的全局特性。本工作进一步构建USEMA——一种融合卷积神经网络局部特征提取能力与SEMA注意力的混合UNet架构。我们在多种成像模态和图像尺寸上对USEMA进行实验,结果表明:相较于使用全自注意力的变压器模型,其计算效率显著提升;相比纯卷积或基于Mamba的模型,分割性能更优。

原文摘要 · Abstract (English)

Accurate medical image segmentation is an integral part of the medical image analysis pipeline that requires the ability to merge local and global information. While vision transformers are able to capture global interactions using vanilla self-attention, their quadratic computational complexity in the input size remains a struggle for medical image segmentation tasks. Motivated by the dispersion property of vanilla self-attention and recent development of Mamba form of attention, Scalable and Efficient Mamba like Attention (SEMA) utilizes token localization via local window attention to avoid dispersion and maintain focusing, complemented by theoretically consistent arithmetic averaging to capture global aspect of attention. In this work, we present USEMA, a hybrid UNet architecture that merges the local feature extraction ability of convolutional neural networks (CNNs) with SEMA attention. We conduct experiments with USEMA across a variety of modalities and image sizes, demonstrating improved computational efficiency compared to transformer based models using full self-attention, and superior segmentation performance relative to purely convolution and Mamba-based models.

医学图像分割注意力机制高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。