用可学习的纹理特征增强视觉Transformer,提升医学图像分割精度。
GLoG-CSUnet: Enhancing Vision Transformers with Adaptable Radiomic Features for Medical Image Segmentation
- 引入可自适应的Gabor与LoG滤波器提取纹理边界信息
- 在Synapse和ACDC数据集上分别提升1.14%和0.99%的Dice分数
- 仅增加少量参数,适配多种Transformer模型,适合小样本医疗图像分析
视觉变压器(ViTs)在医学图像语义分割中展现出捕捉长程依赖关系的潜力,但对局部空间信息建模能力不足,尤其在缺乏大规模预训练的小数据集上表现受限。本文提出一种新架构GLoG-CSUnet,通过引入可学习的放射组学特征来增强基于Transformer的模型。该方法结合动态自适应的Gabor与拉普拉斯高斯(LoG)滤波器,有效捕获纹理、边缘与边界信息,强化了Transformer处理的特征表示。其独特之处在于融合了Transformer的长程建模能力与Gabor、LoG的纹理分析优势。在Synapse多器官与ACDC心脏分割数据集上的实验表明,该方法显著优于现有模型,在Synapse上实现1.14%的Dice分数提升,在ACDC上提升0.99%,且计算开销极低(分别仅增加15和30个参数)。该设计灵活,可集成至多种基础模型,为将放射组学启发的特征提取融入Transformer架构提供了新路径。代码已开源:https://github.com/HAAIL/GLoG-CSUnet。
原文摘要 · Abstract (English)
Vision Transformers (ViTs) have shown promise in medical image semantic segmentation (MISS) by capturing long-range correlations. However, ViTs often struggle to model local spatial information effectively, which is essential for accurately segmenting fine anatomical details, particularly when applied to small datasets without extensive pre-training. We introduce Gabor and Laplacian of Gaussian Convolutional Swin Network (GLoG-CSUnet), a novel architecture enhancing Transformer-based models by incorporating learnable radiomic features. This approach integrates dynamically adaptive Gabor and Laplacian of Gaussian (LoG) filters to capture texture, edge, and boundary information, enhancing the feature representation processed by the Transformer model. Our method uniquely combines the long-range dependency modeling of Transformers with the texture analysis capabilities of Gabor and LoG features. Evaluated on the Synapse multi-organ and ACDC cardiac segmentation datasets, GLoG-CSUnet demonstrates significant improvements over state-of-the-art models, achieving a 1.14% increase in Dice score for Synapse and 0.99% for ACDC, with minimal computational overhead (only 15 and 30 additional parameters, respectively). GLoG-CSUnet's flexible design allows integration with various base models, offering a promising approach for incorporating radiomics-inspired feature extraction in Transformer architectures for medical image analysis. The code implementation is available on GitHub at: https://github.com/HAAIL/GLoG-CSUnet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。