将KAN引入Transformer,提升医学图像分类的鲁棒性与效率。
Medical Image Classification with KAN-Integrated Transformers and Dilated Neighborhood Attention
- 首次在Transformer中融合KAN层,增强非线性建模能力。
- 在29项实验中27项达顶尖性能,计算效率提升44%。
- 适合处理多中心临床数据中的图像退化问题。
卷积网络、Transformer、混合模型及基于Mamba的架构在各类医学图像分类任务中表现优异,但主要针对干净标注图像设计。真实临床数据常因多中心研究导致图像退化,源于不同厂商设备差异。本文提出医学视觉Transformer MedViTV2,首次将柯尔莫戈洛夫-阿诺德网络(KAN)层融入Transformer架构,实现泛化医学图像分类。设计高效KAN模块以降低计算开销并提升原MedViT精度;为缓解模型放大时的脆弱性,提出改进的扩张邻域注意力(DiNA),基于高效融合点积注意力核,扩大感受野并捕获全局上下文,有效防止特征崩溃。此外,引入分层混合策略,高效堆叠局部与全局特征感知块,平衡局部与全局特征表达。在17个医学图像分类数据集和12个受损医学图像数据集上的大量实验表明,MedViTV2在29项实验中27项达到最先进水平,计算复杂度显著降低。相比前代版本,其计算效率提升44%,在MedMNIST上准确率提升4.6%,NonMNIST上提升5.8%,在MedMNIST-C基准上提升13.4%。
原文摘要 · Abstract (English)
Convolutional networks, transformers, hybrid models, and Mamba-based architectures have demonstrated strong performance across various medical image classification tasks. However, these methods were primarily designed to classify clean images using labeled data. In contrast, real-world clinical data often involve image corruptions that are unique to multi-center studies and stem from variations in imaging equipment across manufacturers. In this paper, we introduce the Medical Vision Transformer (MedViTV2), a novel architecture incorporating Kolmogorov-Arnold Network (KAN) layers into the transformer architecture for the first time, aiming for generalized medical image classification. We have developed an efficient KAN block to reduce computational load while enhancing the accuracy of the original MedViT. Additionally, to counteract the fragility of our MedViT when scaled up, we propose an enhanced Dilated Neighborhood Attention (DiNA), an adaptation of the efficient fused dot-product attention kernel capable of capturing global context and expanding receptive fields to scale the model effectively and addressing feature collapse issues. Moreover, a hierarchical hybrid strategy is introduced to stack our Local Feature Perception and Global Feature Perception blocks in an efficient manner, which balances local and global feature perceptions to boost performance. Extensive experiments on 17 medical image classification datasets and 12 corrupted medical image datasets demonstrate that MedViTV2 achieved state-of-the-art results in 27 out of 29 experiments with reduced computational complexity. MedViTV2 is 44\% more computationally efficient than the previous version and significantly enhances accuracy, achieving improvements of 4.6\% on MedMNIST, 5.8\% on NonMNIST, and 13.4\% on the MedMNIST-C benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。