arXiv:2603.09530cs.CV2026-03

提出新型注意力与特征融合机制,提升医学图像分割精度与效率

DCAU-Net: Differential Cross Attention and Channel-Spatial Feature Fusion for Medical Image Segmentation

  • 设计差分交叉注意力,动态聚焦关键结构,降低计算开销
  • 通过通道-空间分步融合,增强边界细节与语义信息整合
  • 适用于高精度医学图像分割,尤其适合小样本或复杂病灶场景

精准的医学图像分割需同时建模长程依赖和细粒度边界细节。尽管变换器缓解了卷积神经网络感受野有限导致的语义信息不足问题,但标准自注意力存在二次计算复杂度,并常为无关区域分配显著注意力权重,削弱对判别性结构的关注,最终影响分割精度。现有注意力变体虽能降低计算量,却未能有效抑制冗余计算,且损害全局上下文建模能力。此外,传统编码器-解码器架构中的融合策略多采用简单拼接或相加,难以自适应地融合高层语义与低层空间细节。为此,我们提出DCAU-Net,一种新颖高效的分割框架,包含两个核心设计:其一,提出差分交叉注意力(DCA),通过计算两个独立Softmax注意力图的差异,自适应突出判别性结构;通过将像素级键值令牌替换为窗口级汇总令牌,显著降低计算复杂度而不牺牲精度。其二,引入通道-空间特征融合(CSFF)策略,通过顺序的通道与空间注意力,自适应校准跳跃连接与上采样路径的特征,有效抑制冗余信息并强化显著线索。在两个公开数据集上的实验表明,DCAU-Net在保持高效的同时实现了更具竞争力的分割性能与鲁棒性。

原文摘要 · Abstract (English)

Accurate medical image segmentation requires effective modeling of both long-range dependencies and fine-grained boundary details. While transformers mitigate the issue of insufficient semantic information arising from the limited receptive field inherent in convolutional neural networks, they introduce new challenges: standard self-attention incurs quadratic computational complexity and often assigns non-negligible attention weights to irrelevant regions, diluting focus on discriminative structures and ultimately compromising segmentation accuracy. Existing attention variants, although effective in reducing computational complexity, fail to suppress redundant computation and inadvertently impair global context modeling. Furthermore, conventional fusion strategies in encoder-decoder architectures, typically based on simple concatenation or summation, can not adaptively integrate high-level semantic information with low-level spatial details. To address these limitations, we propose DCAU-Net, a novel yet efficient segmentation framework with two key ideas. First, a new Differential Cross Attention (DCA) is designed to compute the difference between two independent softmax attention maps to adaptively highlight discriminative structures. By replacing pixel-wise key and value tokens with window-level summary tokens, DCA dramatically reduces computational complexity without sacrificing precision. Second, a Channel-Spatial Feature Fusion (CSFF) strategy is introduced to adaptively recalibrate features from skip connections and up-sampling paths through using sequential channel and spatial attention, effectively suppressing redundant information and amplifying salient cues. Experiments on two public benchmarks demonstrate that DCAU-Net achieves competitive performance with enhanced segmentation accuracy and robustness.

医学图像注意力机制分割模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。