用双向空间感知和多尺度自蒸馏提升脑部3D分割精度与效率
MSD-KMamba: Bidirectional Spatial-Aware Multi-Modal 3D Brain Segmentation via Multi-scale Self-Distilled Fusion Strategy
- 引入双向空间感知与多尺度自蒸馏融合策略
- 在多个数据集上实现更高分割精度且计算效率优越
- 适合需要高精度与低资源消耗的医学图像分割任务
众多基于CNN-Transformer混合结构的模型依赖复杂的全局注意力机制来捕捉长程依赖,导致非线性计算复杂度上升和资源消耗过大。尽管知识蒸馏和稀疏注意力可提升效率,但常难以满足复杂任务所需的高分割精度。如何平衡性能与效率仍是关键挑战。本文提出一种新型3D多模态图像分割框架MSD-KMamba,融合双向空间感知与多尺度自蒸馏策略。双向空间感知分支有效捕获脑区间的长程空间上下文依赖,并具备强大的非线性特征提取能力,增强对复杂异质模式的学习。多尺度自蒸馏融合策略强化层级特征表示,提升不同分辨率下的语义信息传递。通过联合利用二者,框架有效缓解体积分割中二次计算复杂度的瓶颈,同时克服全局感知不足的问题。在多个标准基准数据集上的大量实验表明,MSD-KMamba在分割精度、鲁棒性和泛化能力方面持续优于当前最先进方法,且保持高效计算与良好可扩展性。源码已公开于https://github.com/daimao-zhang/MSD-KMamba。
原文摘要 · Abstract (English)
Numerous CNN-Transformer hybrid models rely on high-complexity global attention mechanisms to capture long-range dependencies, which introduces non-linear computational complexity and leads to significant resource consumption. Although knowledge distillation and sparse attention mechanisms can improve efficiency, they often fall short of delivering the high segmentation accuracy necessary for complex tasks. Balancing model performance with computational efficiency remains a critical challenge. In this work, we propose a novel 3D multi-modal image segmentation framework, termed MSD-KMamba, which integrates bidirectional spatial perception with multi-scale self-distillation. The bidirectional spatial aware branch effectively captures long-range spatial context dependencies across brain regions, while also incorporating a powerful nonlinear feature extraction mechanism that further enhances the model's ability to learn complex and heterogeneous patterns. In addition, the proposed multi-scale self-distilled fusion strategy strengthens hierarchical feature representations and improves the transfer of semantic information at different resolution levels. By jointly leveraging the bidirectional spatial perception branch and the multi-scale self-distilled fusion strategy, our framework effectively mitigates the bottleneck of quadratic computational complexity in volumetric segmentation, while simultaneously addressing the limitation of insufficient global perception. Extensive experiments on multiple standard benchmark datasets demonstrate that MSD-KMamba consistently outperforms state-of-the-art methods in segmentation accuracy, robustness, and generalization, while maintaining high computational efficiency and favorable scalability. The source code of MSD-KMamba is publicly available at https://github.com/daimao-zhang/MSD-KMamba.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。