提出轻量级混合网络,提升医学图像分割精度与速度。
CATFA-Net: A Trans-Convolutional Approach for Accurate Medical Image Segmentation
- 用新注意力机制融合卷积与变压器特征,降低计算开销。
- 在GLaS和ISIC 2018上达94.48%和91.55%的Dice分数,刷新纪录。
- 适合追求高精度与低延迟的医学影像分析场景。
卷积块在医学图像分割中表现优异,但难以捕捉长距离依赖。基于Transformer的架构通过注意力机制建模全局上下文,弥补了这一缺陷。近期研究尝试将Transformer编码器与卷积解码器结合,但存在归纳偏置不足、计算成本高、对数据变化鲁棒性差等问题。为此,本文提出CATFA-Net,一种新型高效分割框架,可在减少计算开销的同时提升推理速度与分割质量。该框架采用分层混合编码器结构,结合轻量级卷积解码器。其基于Transformer的编码器引入一种新型上下文叠加注意力(Context Addition Attention),在不具二次复杂度的前提下捕捉跨图像依赖关系。通过提出的跨通道注意力机制,将变压器分支特征与卷积分支特征融合,有效保留空间与通道信息。解码器中的空间融合注意力机制进一步优化特征表示,降低背景噪声干扰。在五个公开数据集上的实验表明,CATFA-Net在准确率与效率方面均优于现有方法。在GLaS(Dice=94.48%)和ISIC 2018(Dice=91.55%)上达到新最优性能。鲁棒性测试与外部验证进一步证明其在二分类任务中的强泛化能力。
原文摘要 · Abstract (English)
Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance. Transformer-based architectures, leveraging attention mechanisms, address this limitation by modeling global context and creating expressive feature representations. Recent research has explored this potential by introducing hybrid frameworks that combine transformer encoders with convolutional decoders. Despite their advantages, these approaches face challenges such as limited inductive bias, high computational cost, and reduced robustness to data variability. To overcome these issues, this study introduces CATFA-Net, a novel and efficient segmentation framework designed to produce high-quality segmentation masks while reducing computational costs and increasing inference speed. CATFA-Net employs a hierarchical hybrid encoder architecture with a lightweight convolutional decoder backbone. Its transformer-based encoder uses a new Context Addition Attention mechanism that captures inter-image dependencies without the quadratic complexity of standard attention mechanisms. Features from the transformer branch are fused with those from the convolutional branch through a proposed Cross-Channel Attention mechanism, which helps retain spatial and channel information during downsampling. Additionally, a Spatial Fusion Attention mechanism in the decoder refines features while reducing background noise ambiguity. Extensive evaluations on five publicly available datasets show that CATFA-Net outperforms existing methods in accuracy and efficiency. The framework sets new state-of-the-art Dice scores on GLaS (94.48%) and ISIC 2018 (91.55%). Robustness tests and external validation further demonstrate its strong ability to generalize in binary segmentation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。