arXiv:2603.00143cs.CVcs.LG2026-03被引 2

用细胞图结构提升病理图像自监督学习,更高效且准确。

GrapHist: Graph Self-Supervised Learning for Histopathology

  • 将组织视为细胞图,结合掩码自编码器与异质图网络
  • 在1100万张细胞图上预训练,参数量少4倍且性能领先
  • 适合做癌症分型等下游任务,尤其擅长复杂微环境建模

自监督视觉模型在数字病理学中表现优异,但其通用的Transformer架构未考虑组织切片中的核心生物要素——细胞及其复杂相互作用。本文提出假设:将组织建模为细胞图,能实现更高效的表征学习。为此,我们开发了GrapHist,一种基于图的自监督学习框架,可生成通用且结构感知的嵌入表示,支持多种下游任务。GrapHist融合了掩码自编码器与专为捕捉肿瘤微环境异质性设计的异质图神经网络,在1100万张乳腺组织细胞图上进行预训练,并在域内和域外基准上评估其迁移能力。结果表明,GrapHist在切片、区域和细胞层级任务中表现媲美视觉模型,参数量减少四倍;在癌症亚型分类任务中显著优于全监督图模型。此外,我们还发布了五个基于图的数字病理数据集,构建了该领域首个大规模图基准。代码已开源。

原文摘要 · Abstract (English)

Self-supervised vision models have achieved notable success in digital pathology. However, their domain-agnostic transformer architectures are not originally designed to account for fundamental biological elements of histopathology images, namely cells and their complex interactions. In this work, we hypothesize that a biologically-informed modeling of tissues as cell graphs offers a more efficient representation learning. Thus, we introduce GrapHist, a novel graph-based self-supervised learning framework for histopathology, which learns generalizable and structurally-informed embeddings that enable diverse downstream tasks. GrapHist integrates masked autoencoders and heterophilic graph neural networks that are explicitly designed to capture the heterogeneity of tumor microenvironments. We pre-train GrapHist on a large collection of 11 million cell graphs derived from breast tissues and evaluate its transferability across in- and out-of-domain benchmarks. Our results show that GrapHist achieves competitive performance compared to its vision-based counterparts in slide-, region-, and cell-level tasks, while requiring four times fewer parameters. It also drastically outperforms fully-supervised graph models on cancer subtyping tasks. Finally, we also release five graph-based digital pathology datasets used in our study at https://huggingface.co/ogutsevda/datasets , establishing the first large-scale graph benchmark in this field. Our code is available at https://github.com/ogutsevda/graphist .

病理图像图神经网络自监督学习细胞图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。