用Mamba和KAN结合提升医学图像分割效率与精度。
MedVKAN: Efficient Feature Extraction with Mamba and KAN for Medical Image Segmentation
- 用VSS+EFC-KAN模块替代Transformer,实现高效特征提取。
- 在五个数据集上四个达顶尖水平,一个第二,性能全面领先。
- 适合关注医学图像分割效率与模型轻量化的研究者使用。
医学图像分割传统依赖卷积神经网络(CNN)和基于Transformer的模型。然而,CNN受限于感受野有限,而Transformer因计算复杂度呈二次增长面临可扩展性挑战。为克服这些问题,近期研究探索了新架构。Mamba模型采用选择性状态空间设计,实现近线性复杂度并有效捕捉长程依赖;其视觉变体视觉状态空间(VSS)将此优势延伸至图像特征学习。同时,柯尔莫哥洛夫-阿诺德网络(KAN)通过可学习激活函数增强非线性表达能力。受此启发,我们提出增强VSS的KAN(VKAN)模块,将VSS与扩展感受野卷积KAN(EFC-KAN)结合,取代Transformer模块以强化特征提取。进一步将VKAN嵌入U-Net框架,构建出MedVKAN模型。在五个公开数据集上的大量实验表明,MedVKAN在四个数据集上达到当前最优性能,在剩余一个数据集排名第二。结果验证了Mamba与KAN结合的有效性,并引入一种新颖且计算高效的特征提取框架。源代码已开源:https://github.com/beginner-cjh/MedVKAN。
原文摘要 · Abstract (English)
Medical image segmentation has traditionally relied on convolutional neural networks (CNNs) and Transformer-based models. CNNs, however, are constrained by limited receptive fields, while Transformers face scalability challenges due to quadratic computational complexity. To over-come these issues, recent studies have explored alternative architectures. The Mamba model, a selective state-space design, achieves near-linear complexity and effectively captures long-range dependencies. Its vision-oriented variant, the Visual State Space (VSS) model, extends these strengths to image feature learning. In parallel, the Kolmogorov-Arnold Network (KAN) enhanc-es nonlinear expressiveness by replacing fixed activation functions with learnable ones. Moti-vated by these advances, we propose the VSS-Enhanced KAN (VKAN) module, which integrates VSS with the Expanded Field Convolutional KAN (EFC-KAN) as a replacement for Transformer modules, thereby strengthening feature extraction. We further embed VKAN into a U-Net frame-work, resulting in MedVKAN, an efficient medical image segmentation model. Extensive exper-iments on five public datasets demonstrate that MedVKAN achieves state-of-the-art performance on four datasets and ranks second on the remaining one. These results underscore the effective-ness of combining Mamba and KAN while introducing a novel and computationally efficient feature extraction framework. The source code is available at: https://github.com/beginner-cjh/MedVKAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。