arXiv:2602.03156cs.CVcs.LG2026-02被引 1

首个全柯尔莫哥洛夫-阿诺德网络模型,实现医学图像分割性能飞跃。

Fully Kolmogorov-Arnold Deep Model in Medical Image Segmentation

  • 提出SaKAN和无梯度样条,解决深层KAN训练难、内存高的问题。
  • 在三个医学图像分割任务中,准确率全面超越传统与部分KAN模型。
  • 适合追求高效高精度深度学习模型的研究者与医疗AI开发者。

由于训练难度高和内存需求大,深层堆叠的柯尔莫哥洛夫-阿诺德网络(KAN)在实践中几乎不可行,现有研究仅能引入少量KAN层,限制了对KAN的深入探索。本文克服这些瓶颈,提出首个完全基于柯尔莫哥洛夫-阿诺德(KA)架构的深度模型。首先,提出的共享激活KAN(SaKAN)重构了Sprecher版本的柯尔莫哥洛夫-阿诺德表示定理,通过简化参数化和更密集的训练样本,提升优化效率;其次,发现样条梯度对训练贡献微小却占用大量GPU内存,因而提出无梯度样条以显著降低内存消耗与计算开销。在此基础上,构建了首个完整基于KA的深度模型ALL U-KAN,其中新提出的KA层和KAonv层完全替代了传统的全连接(FC)和卷积(Conv)层。在三个医学图像分割任务上的广泛评估表明,全KA架构优于部分KA及传统架构,实现了更高分割精度。相比直接深层堆叠的KAN,ALL U-KAN参数量减少10倍,内存消耗降低超过20倍,为深层KAN架构的探索打开新可能。

原文摘要 · Abstract (English)

Deeply stacked KANs are practically impossible due to high training difficulties and substantial memory requirements. Consequently, existing studies can only incorporate few KAN layers, hindering the comprehensive exploration of KANs. This study overcomes these limitations and introduces the first fully KA-based deep model, demonstrating that KA-based layers can entirely replace traditional architectures in deep learning and achieve superior learning capacity. Specifically, (1) the proposed Share-activation KAN (SaKAN) reformulates Sprecher's variant of Kolmogorov-Arnold representation theorem, which achieves better optimization due to its simplified parameterization and denser training samples, to ease training difficulty, (2) this paper indicates that spline gradients contribute negligibly to training while consuming huge GPU memory, thus proposes the Grad-Free Spline to significantly reduce memory usage and computational overhead. (3) Building on these two innovations, our ALL U-KAN is the first representative implementation of fully KA-based deep model, where the proposed KA and KAonv layers completely replace FC and Conv layers. Extensive evaluations on three medical image segmentation tasks confirm the superiority of the full KA-based architecture compared to partial KA-based and traditional architectures, achieving all higher segmentation accuracy. Compared to directly deeply stacked KAN, ALL U-KAN achieves 10 times reduction in parameter count and reduces memory consumption by more than 20 times, unlocking the new explorations into deep KAN architectures.

医学图像深度学习KAN模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。