针对小病灶分割难题,提出多维度敏感的S³-Mamba模型。
{S$^3$-Mamba}: Small-Size-Sensitive Mamba for Lesion Segmentation
- 设计增强视觉状态空间块,保留局部细节并聚焦小病灶。
- 引入张量交叉特征多尺度注意力,融合多粒度空间信息。
- 采用正则化课程学习,自动识别难样本并逐步优化训练。
小病灶在早期疾病诊断和严重感染干预中至关重要。现有模型在分割小病灶时面临挑战,因其仅占图像极小部分,且下采样操作易丢失局部特征。为此,我们提出小型尺寸敏感的Mamba(S³-Mamba),从通道、空间和训练策略三个维度提升对小病灶的敏感性。具体地,设计增强视觉状态空间块,通过多重残差连接保留局部特征,并利用通道注意力选择性放大关键细节、抑制无关信息。提出张量交叉特征多尺度注意力,融合输入图像特征与中间层特征及边缘特征,实现多尺度特征的注意力支持,从而在不同粒度下保持小病灶的空间细节。最后,引入新型正则化课程学习,自动评估病灶大小与样本难度,逐步从简单样本转向困难样本(如小病灶)。在三个医学图像分割数据集上的大量实验表明,S³-Mamba在小病灶分割上表现优异。代码已开源:https://github.com/ErinWang2023/S3-Mamba。
原文摘要 · Abstract (English)
Small lesions play a critical role in early disease diagnosis and intervention of severe infections. Popular models often face challenges in segmenting small lesions, as it occupies only a minor portion of an image, while down\_sampling operations may inevitably lose focus on local features of small lesions. To tackle the challenges, we propose a {\bf S}mall-{\bf S}ize-{\bf S}ensitive {\bf Mamba} ({\bf S$^3$-Mamba}), which promotes the sensitivity to small lesions across three dimensions: channel, spatial, and training strategy. Specifically, an Enhanced Visual State Space block is designed to focus on small lesions through multiple residual connections to preserve local features, and selectively amplify important details while suppressing irrelevant ones through channel-wise attention. A Tensor-based Cross-feature Multi-scale Attention is designed to integrate input image features and intermediate-layer features with edge features and exploit the attentive support of features across multiple scales, thereby retaining spatial details of small lesions at various granularities. Finally, we introduce a novel regularized curriculum learning to automatically assess lesion size and sample difficulty, and gradually focus from easy samples to hard ones like small lesions. Extensive experiments on three medical image segmentation datasets show the superiority of our S$^3$-Mamba, especially in segmenting small lesions. Our code is available at https://github.com/ErinWang2023/S3-Mamba.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。