用图模型捕捉组织切片中的语义结构,提升病理分类准确率
Semantic-Aware Subgraph State Space Model for WSI Classification in Histopathology

- 基于视觉-语义先验自适应聚合空间相邻切片,构建语义子图
- 在4个数据集上超越主流方法,小样本下仍保持稳定性能
- 适合需要高精度病理分析的医学影像研究者
组织病理学分型依赖于对特征性组织模式的识别,这些模式可能由单一组织结构或多个结构的空间分布与共现关系表达,常呈现不规则形状的组织区域,本文称之为语义单元。传统基于切片的方法会破坏这些单元的完整性,且难以高效建模大量空间分离单元间的关联。为此,我们提出语义感知子图状态空间模型(SASG-SSM),用于全切片图像(WSI)分类。首先,语义感知子图(SASGs)通过类无关的视觉-语义先验自适应聚合空间相连的切片,形成保留内部空间结构的图节点。随后,子图状态空间模块(SG-SSM)结合图神经网络编码器处理子图内拓扑,以及基于Mamba的状态空间编码器高效建模大量子图间的上下文关系。该模块融合了语义单元内的局部结构信息与跨切片分布和共现的全局上下文信息,同时高效处理大规模空间区域。在四个病理切片分型数据集上的实验表明,该方法持续优于现有先进方法。在小样本及少样本设置下的评估也验证了其在有限训练数据下的鲁棒性与数据效率。代码将发布于https://github.com/HLSvois/SASG-SSM。
原文摘要 · Abstract (English)
Histopathological subtyping relies on the recognition of characteristic histological patterns. These patterns may be expressed by individual tissue structures or by the spatial distribution and co-occurrence of multiple structures, and they often span irregularly shaped tissue regions, termed semantic units in this work. However, conventional patch-based representations may fragment such units and fail to explicitly preserve their internal spatial organization, while efficiently modeling relationships among numerous spatially separated units remains challenging. To address these limitations, we propose the Semantic-Aware Subgraph State Space Model (SASG-SSM), a flexible and efficient framework for whole slide image (WSI) classification. Semantic-Aware Subgraphs (SASGs) first approximate irregularly shaped semantic units by adaptively grouping spatially connected patches guided by class-agnostic visual-semantic priors. By representing patches as graph nodes with adjacency edges, SASGs preserve their internal spatial organization rather than treating them as an unordered set. A Subgraph State Space Module (SG-SSM) subsequently combines a graph neural network encoder for intra-subgraph topology encoding with a Mamba-based state space encoder for efficient contextualization across large numbers of subgraphs. This module integrates local structural information within semantic units with global contextual information arising from their distribution and co-occurrence across the WSI, while efficiently modeling a large number of spatially distributed regions. Extensive experiments across four WSI subtyping datasets demonstrate consistent advantages over representative state-of-the-art methods. Further evaluations under small-cohort and few-shot settings demonstrate robustness and data efficiency under limited training data. Code will be released at https://github.com/HLSvois/SASG-SSM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。