用KAN网络提升医学图像分割的少标注学习能力
Semi-KAN: KAN Provides an Effective Representation for Semi-Supervised Learning in Medical Image Segmentation
- 将可学习激活函数的KAN引入U-Net,仅用少量层实现更好表征
- 在四个公开数据集上超越基线模型,计算开销更低
- 适合资源有限但需高精度分割的医疗图像场景
基于深度学习的医学图像分割已取得显著成果,但通常需要大量像素级标注,成本高昂。半监督医学图像分割(SSMIS)提供了一种可行替代方案,依赖于CNN和ViT的发展。然而,这些网络常采用固定激活函数和线性建模模式,限制了其学习鲁棒表征的能力。鉴于标注数据稀缺,鲁棒表征学习尤为关键。受科尔莫戈罗夫-阿诺德网络(KANs)启发,本文提出Semi-KAN,挖掘KAN在表征学习中的潜力。研究发现:(1) 相较于固定激活函数网络,KAN在参数更少时具备更强表征能力;(2) KAN在高语义特征空间表现优异。在此基础上,将KAN集成到分块中间表示中,选择性地部署在U-Net编码器瓶颈和解码器顶层以提取高层语义特征。尽管可学习激活函数能提升特征扩展,但带来显著计算开销且性能提升微弱。为此,降低特征维度并采用横向扩展以捕捉多模式表征。此外,设计带不确定估计的多分支U-Net架构,有效学习多样化模式。在四个公开数据集上的大量实验表明,Semi-KAN在使用更少KAN层和更低计算成本下优于基线模型,验证了KAN在半监督医学图像分割中的潜力。
原文摘要 · Abstract (English)
Deep learning-based medical image segmentation has shown remarkable success; however, it typically requires extensive pixel-level annotations, which are both expensive and time-intensive. Semi-supervised medical image segmentation (SSMIS) offers a viable alternative, driven by advancements in CNNs and ViTs. However, these networks often rely on single fixed activation functions and linear modeling patterns, limiting their ability to effectively learn robust representations. Given the limited availability of labeled date, achieving robust representation learning becomes crucial. Inspired by Kolmogorov-Arnold Networks (KANs), we propose Semi-KAN, which leverages the untapped potential of KANs to enhance backbone architectures for representation learning in SSMIS. Our findings indicate that: (1) compared to networks with fixed activation functions, KANs exhibit superior representation learning capabilities with fewer parameters, and (2) KANs excel in high-semantic feature spaces. Building on these insights, we integrate KANs into tokenized intermediate representations, applying them selectively at the encoder's bottleneck and the decoder's top layers within a U-Net pipeline to extract high-level semantic features. Although learnable activation functions improve feature expansion, they introduce significant computational overhead with only marginal performance gains. To mitigate this, we reduce the feature dimensions and employ horizontal scaling to capture multiple pattern representations. Furthermore, we design a multi-branch U-Net architecture with uncertainty estimation to effectively learn diverse pattern representations. Extensive experiments on four public datasets demonstrate that Semi-KAN surpasses baseline networks, utilizing fewer KAN layers and lower computational cost, thereby underscoring the potential of KANs as a promising approach for SSMIS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。