提出线性注意力模块,实现高精度医学图像分割且计算高效。
Gated Differential Linear Attention: A Linear-Time Decoder for High-Fidelity Medical Segmentation
- 设计双分支线性注意力,通过差分抑制冗余响应
- 在多模态医学影像上达到顶尖分割精度
- 适合需要边界精细的临床级分割场景
医学图像分割需在保持解剖边界精细度的同时具备临床部署可行性。Transformer虽能捕捉长程依赖,但注意力复杂度为二次方;CNN效率高却全局推理能力弱。线性注意力可实现 \\(\mathcal{O}(N)\\) 复杂度,但常导致特征聚合模糊,削弱边界敏感性。本文提出门控差分线性注意力混合器(GDLA),其全局路径通过互补查询/键子空间的核化注意力分支间差分相减,抑制冗余响应,并引入数据依赖门控进行令牌精炼。并行的局部深度卷积分支增强邻域交互,两分支融合后仍保持 \\(\mathcal{O}(N)\\) 复杂度。在预训练的金字塔视觉变压器(PVT)编码器-解码器架构中,该方法在涵盖CT、MRI、超声和皮肤镜的多个2D医学分割基准上达到当前最优性能,相较于相近基线具有更优的精度-效率权衡。代码已公开于:https://github.com/xmindflow/gdla。
原文摘要 · Abstract (English)
Medical image segmentation requires models that preserve fine anatomical boundaries while remaining practical for clinical deployment. Transformers capture long-range dependencies but incur quadratic attention cost, whereas CNNs are efficient but less effective at global reasoning. Linear attention offers \(\mathcal{O}(N)\) scaling, but often produces diffuse feature aggregation that weakens boundary-sensitive prediction. We introduce a gated differential linear-attention mixer for medical image segmentation. Its global path, Gated Differential Linear Attention (GDLA), performs differential subtraction between two kernelized attention branches over complementary query/key subspaces to suppress redundant responses, and employs a data-dependent gate for token refinement. A parallel local token-mixing branch with depthwise convolution strengthens neighborhood interactions for better refinement, and the two branches are fused while preserving \(\mathcal{O}(N)\) complexity. When instantiated in a pretrained Pyramid Vision Transformer (PVT)-based encoder--decoder model, \name achieves state-of-the-art results on the evaluated 2D medical segmentation benchmarks spanning CT, MRI, ultrasound, and dermoscopy, with a favorable accuracy--efficiency trade-off over closely related baselines. The code is publicly available at \href{https://github.com/xmindflow/gdla}{https://github.com/xmindflow/gdla}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。