用Mamba架构实现神经元分割的全局与局部特征融合,提升边界精度。
NeuroMamba: Multi-Perspective Feature Interaction with Visual Mamba for Neuron Segmentation
- 基于Mamba的无补丁全局建模,捕捉长距离依赖关系。
- 在四个公开电子显微镜数据集上达到顶尖性能,适配各向异性和各向同性分辨率。
- 结合局部形态特征提取与连续空间扫描机制,精准保留细节信息。
神经元分割是构建完整神经连接组的关键,对理解大脑功能组织至关重要。神经元不规则形态和密集交织结构使该任务极具挑战。现有基于CNN的方法因缺乏长程上下文而难以分辨模糊边界,而基于Transformer的方法则因分块处理导致体素级细节丢失,造成边界不精确。为此,我们提出NeuroMamba,一种多视角框架,利用Mamba的线性复杂度实现无补丁全局建模,并与互补的局部特征建模协同,高效捕捉长程依赖同时精细保留体素级细节。具体而言,设计通道门控的边界判别特征提取器(BDFE)增强局部形态线索;引入空间连续特征提取器(SCFE),将分辨率感知扫描机制融入Visual Mamba架构,自适应建模不同分辨率下的全局依赖;最后通过交叉调制机制融合多视角特征。方法在四个公开电子显微镜数据集上表现领先,验证其在各向异性与各向同性分辨率下的卓越适应性。源代码将公开。
原文摘要 · Abstract (English)
Neuron segmentation is the cornerstone of reconstructing comprehensive neuronal connectomes, which is essential for deciphering the functional organization of the brain. The irregular morphology and densely intertwined structures of neurons make this task particularly challenging. Prevailing CNN-based methods often fail to resolve ambiguous boundaries due to the lack of long-range context, whereas Transformer-based methods suffer from boundary imprecision caused by the loss of voxel-level details during patch partitioning. To address these limitations, we propose NeuroMamba, a multi-perspective framework that exploits the linear complexity of Mamba to enable patch-free global modeling and synergizes this with complementary local feature modeling, thereby efficiently capturing long-range dependencies while meticulously preserving fine-grained voxel details. Specifically, we design a channel-gated Boundary Discriminative Feature Extractor (BDFE) to enhance local morphological cues. Complementing this, we introduce the Spatial Continuous Feature Extractor (SCFE), which integrates a resolution-aware scanning mechanism into the Visual Mamba architecture to adaptively model global dependencies across varying data resolutions. Finally, a cross-modulation mechanism synergistically fuses these multi-perspective features. Our method demonstrates state-of-the-art performance across four public EM datasets, validating its exceptional adaptability to both anisotropic and isotropic resolutions. The source code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。