arXiv:2603.06186cs.CV2026-03AAAI

融合病理图像与空间转录组数据,提升癌症区域检测准确率

SpaCRD: Multimodal Deep Fusion of Histology and Spatial Transcriptomics for Cancer Region Detection

  • 通过双向交叉注意力融合病理图像与基因表达信息
  • 在23个跨平台数据集上显著优于现有方法
  • 适用于不同设备和批次的样本,具备强泛化能力

精准识别癌变组织区域(CTR)有助于深入解析肿瘤微环境并预测治疗反应。传统方法依赖病理图像中的细胞形态,但易因不同组织区域形态相似导致误检。空间转录组技术提供了细胞表型与空间定位的高精度信息,为更准确的CTR检测带来新可能。然而,现有方法难以有效整合病理图像与空间转录组数据,尤其在跨样本、跨平台/批次场景下表现受限。为此,我们提出SpaCRD,一种基于迁移学习的深度多模态融合方法,可实现跨样本、跨平台与跨批次的可靠CTR检测。该方法的核心是类别正则化的变分重建引导双向交叉注意力融合网络,能自适应捕捉组织形态与基因表达间的潜在共表达模式。在涵盖多种疾病类型、平台与批次的23个配对数据集上的基准测试表明,SpaCRD始终优于8种先进方法。

原文摘要 · Abstract (English)

Accurate detection of cancer tissue regions (CTR) enables deeper analysis of the tumor microenvironment and offers crucial insights into treatment response. Traditional CTR detection methods, which typically rely on the rich cellular morphology in histology images, are susceptible to a high rate of false positives due to morphological similarities across different tissue regions. The groundbreaking advances in spatial transcriptomics (ST) provide detailed cellular phenotypes and spatial localization information, offering new opportunities for more accurate cancer region detection. However, current methods are unable to effectively integrate histology images with ST data, especially in the context of cross-sample and cross-platform/batch settings for accomplishing the CTR detection. To address this challenge, we propose SpaCRD, a transfer learning-based method that deeply integrates histology images and ST data to enable reliable CTR detection across diverse samples, platforms, and batches. Once trained on source data, SpaCRD can be readily generalized to accurately detect cancerous regions across samples from different platforms and batches. The core of SpaCRD is a category-regularized variational reconstruction-guided bidirectional cross-attention fusion network, which enables the model to adaptively capture latent co-expression patterns between histological features and gene expression from multiple perspectives. Extensive benchmark analysis on 23 matched histology-ST datasets spanning various disease types, platforms, and batches demonstrates that SpaCRD consistently outperforms existing eight state-of-the-art methods in CTR detection.

癌症检测多模态融合空间转录组病理分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。