用轻量KAN+Transformer改进U-Net,少参数实现更准医学图像分割。
TransUKAN:Computing-Efficient Hybrid KAN-Transformer for Enhanced Medical Image Segmentation
- 融合KAN与Transformer的混合结构,减少参数量。
- 在多个数据集上性能超越基线,参数减少超50%。
- 适合资源受限场景的高精度医学图像分割任务。
U-Net是当前最广泛使用的医学图像分割架构,凭借其编码器-解码器结构和跳跃连接,能有效提取输入图像特征以分割目标区域。现有U-Net通常基于卷积或Transformer构建,通过建模局部或全局依赖关系完成医学图像分析任务。然而,卷积层、全连接层及注意力机制引入大量参数,常需堆叠多层网络以捕捉复杂非线性关系,影响训练效率。为此,本文提出TransUKAN:首先优化KAN以降低内存占用与计算负载;在此基础上,探索了KAN、Transformer与U-Net结构的有效融合。该方法仅引入少量额外参数,显著增强模型对非线性关系的建模能力,并弥补Transformer在局部信息提取上的不足。在多个医学图像分割任务上验证表明,TransUKAN在大幅减少参数的同时,仍保持优异性能。代码将公开于https://github.com/wuyanlin-wyl/TransUKAN。
原文摘要 · Abstract (English)
U-Net is currently the most widely used architecture for medical image segmentation. Benefiting from its unique encoder-decoder architecture and skip connections, it can effectively extract features from input images to segment target regions. The commonly used U-Net is typically based on convolutional operations or Transformers, modeling the dependencies between local or global information to accomplish medical image analysis tasks. However, convolutional layers, fully connected layers, and attention mechanisms used in this process introduce a significant number of parameters, often requiring the stacking of network layers to model complex nonlinear relationships, which can impact the training process. To address these issues, we propose TransUKAN. Specifically, we have improved the KAN to reduce memory usage and computational load. On this basis, we explored an effective combination of KAN, Transformer, and U-Net structures. This approach enhances the model's capability to capture nonlinear relationships by introducing only a small number of additional parameters and compensates for the Transformer structure's deficiency in local information extraction. We validated TransUKAN on multiple medical image segmentation tasks. Experimental results demonstrate that TransUKAN achieves excellent performance with significantly reduced parameters. The code will be available athttps://github.com/wuyanlin-wyl/TransUKAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。