用图神经网络增强病理图上下文感知,精准分割淋巴结构
GNCAF: A GNN-based Neighboring Context Aggregation Framework for Tertiary Lymphoid Structures Semantic Segmentation in WSI
- 基于图神经网络聚合多跳邻近区域信息,提升局部切片分割精度
- 在两个数据集上实现最高26.57%的mIoU提升,显著优于传统方法
- 适用于复杂病理图像分割,尤其适合免疫微环境研究者
三级淋巴结构(TLS)是免疫细胞组成的有序集群,其成熟度和面积可在全幻灯片图像(WSI)中量化,用于多种预后任务。现有方法通常依赖细胞代理任务,并需额外后处理。本文提出新任务——TLS语义分割(TLS-SS),实现对WSI中TLS区域及其成熟阶段的端到端分割。由于WSI尺度庞大且采用切片分割策略,需要整合邻近切片信息以指导目标切片分割。以往方法多采用多分辨率策略,限制了对大范围上下文的利用,且倾向于保留粗粒度信息。为此,本文提出基于图神经网络的邻域上下文聚合框架(GNCAF),通过逐步聚合目标切片的多跳邻域信息,并引入自注意力机制引导目标分割。该框架可嵌入多种分割模型,增强其对切片外上下文信息的感知能力。我们构建了两个TLS-SS数据集:TCGA-COAD(含225张WSI、5041个TLS)与INHOUSE-PAAD,其中前者已公开。实验表明,GNCAF在两个数据集上分别实现了22.08%和26.57%的mF1与mIoU提升。此外,我们还验证了其在淋巴结转移灶分割中的任务可扩展性。
原文摘要 · Abstract (English)
Tertiary lymphoid structures (TLS) are organized clusters of immune cells, whose maturity and area can be quantified in whole slide image (WSI) for various prognostic tasks. Existing methods for assessing these characteristics typically rely on cell proxy tasks and require additional post-processing steps. In this work, We focus on a novel task-TLS Semantic Segmentation (TLS-SS)-which segments both the regions and maturation stages of TLS in WSI in an end-to-end manner. Due to the extensive scale of WSI and patch-based segmentation strategies, TLS-SS necessitates integrating from neighboring patches to guide target patch (target) segmentation. Previous techniques often employ on multi-resolution approaches, constraining the capacity to leverage the broader neighboring context while tend to preserve coarse-grained information. To address this, we propose a GNN-based Neighboring Context Aggregation Framework (GNCAF), which progressively aggregates multi-hop neighboring context from the target and employs a self-attention mechanism to guide the segmentation of the target. GNCAF can be integrated with various segmentation models to enhance their ability to perceive contextual information outside of the patch. We build two TLS-SS datasets, called TCGA-COAD and INHOUSE-PAAD, and make the former (comprising 225 WSIs and 5041 TLSs) publicly available. Experiments on these datasets demonstrate the superiority of GNCAF, achieving a maximum of 22.08% and 26.57% improvement in mF1 and mIoU, respectively. Additionally, we also validate the task scalability of GNCAF on segmentation of lymph node metastases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。