arXiv:2505.18525cs.CV2025-05被引 1

用KAN与Mamba结合,提升3D医学图像分割的精度和效率。

TK-Mamba: Marrying KAN With Mamba for Text-Driven 3D Medical Image Segmentation

  • 创新融合3D-GR-KAN与Mamba,实现高效非线性特征变换。
  • 在多个数据集上达到最优分割性能,肿瘤与多器官分割均领先。
  • 适合需要高精度、低计算开销的医学图像分析场景。

3D医学图像分割对临床诊断与治疗至关重要,但面临高维数据与复杂空间依赖的挑战。传统单模态网络如CNN与Transformer在3D场景中常受限于计算效率低和上下文建模能力不足。为此,我们提出TK-Mamba,一种融合线性时间Mamba与柯尔莫哥洛夫-阿诺德网络(KAN)的多模态框架,构建高效混合主干。主要贡献有二:其一,首次将KAN应用于3D医学成像,提出新型3D-Group-Rational KAN(3D-GR-KAN),实现高效且优越的非线性特征变换,适用于复杂体结构;其二,设计双分支文本驱动策略,利用PubMedClip嵌入捕捉器官间语义关系,缓解标签不一致问题,并对齐图像特征与解剖文本。结合先进主干与视觉-语言知识,TK-Mamba为多器官与肿瘤分割提供统一可扩展解决方案。在多个数据集上的实验表明,该框架在准确率与效率上均优于现有方法。代码已公开于https://github.com/yhy-whu/TK-Mamba。

原文摘要 · Abstract (English)

3D medical image segmentation is important for clinical diagnosis and treatment but faces challenges from high-dimensional data and complex spatial dependencies. Traditional single-modality networks, such as CNNs and Transformers, are often limited by computational inefficiency and constrained contextual modeling in 3D settings. To alleviate these limitations, we propose TK-Mamba, a multimodal framework that fuses the linear-time Mamba with Kolmogorov-Arnold Networks (KAN) to form an efficient hybrid backbone. Our approach is characterized by two primary technical contributions. Firstly, we introduce the novel 3D-Group-Rational KAN (3D-GR-KAN), which marks the first application of KAN in 3D medical imaging, providing a superior and computationally efficient nonlinear feature transformation crucial for complex volumetric structures. Secondly, we devise a dual-branch text-driven strategy using Pubmedclip's embeddings. This strategy significantly enhances segmentation robustness and accuracy by simultaneously capturing inter-organ semantic relationships to mitigate label inconsistencies and aligning image features with anatomical texts. By combining this advanced backbone and vision-language knowledge, TK-Mamba offers a unified and scalable solution for both multi-organ and tumor segmentation. Experiments on multiple datasets demonstrate that our framework achieves state-of-the-art performance in both organ and tumor segmentation tasks, surpassing existing methods in both accuracy and efficiency. Our code is publicly available at https://github.com/yhy-whu/TK-Mamba

3D分割医学图像KANMamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。