arXiv:2508.05382cs.CV2025-08被引 3

用可变形注意力增强病理图像的空间建模能力,提升全切片分析精度。

Deformable Attention Graph Representation Learning for Histopathology Whole Slide Image Analysis

  • 基于组织块特征构建动态加权有向图,通过可学习偏移捕捉真实空间位置。
  • 在4个基准数据集上达到当前最优性能,尤其在胃部病变分级任务中显著领先。
  • 适合需要精细空间结构理解的病理图像分析研究者使用。

全切片图像(WSI)和兴趣区域(ROI)的精准分类是计算病理学的核心挑战。主流方法多采用多实例学习(MIL),但难以捕捉组织结构间的空间依赖。图神经网络(GNN)可建模实例间关系,但多数依赖静态图结构,忽略组织块的真实空间位置。传统注意力机制缺乏特异性,难以聚焦于形态相关区域。本文提出一种融合可变形注意力的新型GNN框架。基于组织块特征构建动态加权有向图,每个节点通过注意力加权边聚合邻域上下文信息。特别地,引入由真实坐标引导的可学习空间偏移,使模型能自适应关注不同区域的形态相关部分。该设计显著扩展了感受野,同时保持空间特异性。在TCGA-COAD、BRACS、胃肠化生分级和肠道ROI分类四个基准数据集上均取得当前最优结果,验证了可变形注意力在捕捉复杂空间结构中的有效性。

原文摘要 · Abstract (English)

Accurate classification of Whole Slide Images (WSIs) and Regions of Interest (ROIs) is a fundamental challenge in computational pathology. While mainstream approaches often adopt Multiple Instance Learning (MIL), they struggle to capture the spatial dependencies among tissue structures. Graph Neural Networks (GNNs) have emerged as a solution to model inter-instance relationships, yet most rely on static graph topologies and overlook the physical spatial positions of tissue patches. Moreover, conventional attention mechanisms lack specificity, limiting their ability to focus on structurally relevant regions. In this work, we propose a novel GNN framework with deformable attention for pathology image analysis. We construct a dynamic weighted directed graph based on patch features, where each node aggregates contextual information from its neighbors via attention-weighted edges. Specifically, we incorporate learnable spatial offsets informed by the real coordinates of each patch, enabling the model to adaptively attend to morphologically relevant regions across the slide. This design significantly enhances the contextual field while preserving spatial specificity. Our framework achieves state-of-the-art performance on four benchmark datasets (TCGA-COAD, BRACS, gastric intestinal metaplasia grading, and intestinal ROI classification), demonstrating the power of deformable attention in capturing complex spatial structures in WSIs and ROIs.

病理图像图神经网络可变形注意空间建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。