arXiv:2412.10482cs.CVcs.AI2024-12

通过动态实体掩码图扩散模型,提升病理图像自监督表征学习效果。

Dynamic Entity-Masked Graph Diffusion Model for histopathological image Representation Learning

  • 构建实体图并动态生成掩码作为扩散条件与目标。
  • 在三个大数据集上预训练,下游分类与生存分析表现优异。
  • 适合关注病理图像表征、自监督学习的研究者。

自然图像与病理图像特征差异大,难以直接迁移预训练模型。且病理切片常缺乏标注,促使研究者探索基于掩码重建的自监督学习方法。然而,以往方法忽视了实体间的空间交互关系,而这些关系对病理表征至关重要。为此,我们提出H-MGDM,一种基于动态实体掩码图扩散模型的自监督病理图像表征学习方法。通过互补子图分别作为潜在扩散条件和自监督目标,利用图结构嵌入实体拓扑关系以增强表征能力。动态条件与目标有助于更精细的病理重建。模型在三个大型病理数据集上进行预训练,并在六个下游任务(包括分类与生存分析)中展现出先进性能与良好可解释性。代码将公开于https://github.com/centurion-crawler/H-MGDM。

原文摘要 · Abstract (English)

Significant disparities between the features of natural images and those inherent to histopathological images make it challenging to directly apply and transfer pre-trained models from natural images to histopathology tasks. Moreover, the frequent lack of annotations in histopathology patch images has driven researchers to explore self-supervised learning methods like mask reconstruction for learning representations from large amounts of unlabeled data. Crucially, previous mask-based efforts in self-supervised learning have often overlooked the spatial interactions among entities, which are essential for constructing accurate representations of pathological entities. To address these challenges, constructing graphs of entities is a promising approach. In addition, the diffusion reconstruction strategy has recently shown superior performance through its random intensity noise addition technique to enhance the robust learned representation. Therefore, we introduce H-MGDM, a novel self-supervised Histopathology image representation learning method through the Dynamic Entity-Masked Graph Diffusion Model. Specifically, we propose to use complementary subgraphs as latent diffusion conditions and self-supervised targets respectively during pre-training. We note that the graph can embed entities' topological relationships and enhance representation. Dynamic conditions and targets can improve pathological fine reconstruction. Our model has conducted pretraining experiments on three large histopathological datasets. The advanced predictive performance and interpretability of H-MGDM are clearly evaluated on comprehensive downstream tasks such as classification and survival analysis on six datasets. Our code will be publicly available at https://github.com/centurion-crawler/H-MGDM.

病理图像自监督学习图神经网络扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。