arXiv:2608.08374cs.CV2026-08中稿 · BMVC 2026 Conferen…

针对病理图像冗余问题,提出轻量级注意力修正模块提升诊断准确性

Gated Spatial Redundancy Projection for Pathology Transformer Attentions

论文配图:Gated Spatial Redundancy Projection for Pathology Transformer Attentions
图 1 · 摘自论文原文
  • 通过局部冗余轴投影与可学习门控修正注意力输出
  • 在5个生存队列中平均C-index超越基线,提升显著
  • 仅增0.02%参数,适合临床病理分析部署

Transformer模型在计算病理全切片图像(WSI)分析中应用日益广泛。然而,WSI与自然图像有本质区别:相邻切片块常具有高度相似的组织类型、染色、纹理和细胞组成。我们发现这种局部空间冗余是自注意力机制在病理场景下的特异性失效模式,主导邻域特征会反复混入切片标记,削弱细微的诊断或预后差异。为此,提出轻量级嵌入式修正模块Gated Spatial Redundancy Projection(Gated SRP)。对每个切片标记和注意力头,Gated SRP从邻近值向量估计局部冗余轴,将注意力输出投影至该轴,并通过可学习的带符号门控几何修正冗余对齐分量。在五个TCGA生存队列中,Gated SRP在所有队列中均取得最高平均C-index,相比基线注意力平均提升;在五个切片级分类数据集上,16项指标中有12项优于基线,3个数据集达到最佳AUC。代码已公开于https://github.com/AtlasAnalyticsLab/GatedSRP。

原文摘要 · Abstract (English)

Transformer models are increasingly used for whole-slide image analysis in computational pathology. Yet, WSIs differ fundamentally from natural images: neighbouring patches often contain highly similar tissue type, stain, texture, and cellular composition. We identify this local spatial redundancy as a pathology-specific failure mode of self-attention, where dominant neighbourhood features can be repeatedly mixed into patch-tokens and weaken subtle diagnostic or prognostic deviations. We propose Gated Spatial Redundancy Projection (Gated SRP), a lightweight drop-in correction module for self-attention layers. For each patch token and attention head, Gated SRP estimates a local redundancy axis from neighbouring value vectors, projects the attention output onto this axis, and applies a learned signed gate to correct the redundancy-aligned component geometrically. Across five TCGA survival cohorts, Gated SRP obtains the highest mean C-index among the compared attention variants in all cohorts, with an average improvement over the base attention, while adding only +0.02% parameters. Across five slide-level classification datasets, it improves the base attention on 12 of 16 reported metrics and achieves the best AUC on three datasets. Code is publicly available at https://github.com/AtlasAnalyticsLab/GatedSRP.

病理图像注意力机制轻量模型WSI分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。