arXiv:2511.12969cs.CV2025-11AAAI被引 1

用多尺度分析和上下文融合提升病理切片基因表达预测精度

HiFusion: Hierarchical Intra-Spot Alignment and Regional Context Fusion for Spatial Gene Expression Prediction from Histopathology

  • 分层局部建模捕捉斑点内细粒度形态特征
  • 跨尺度注意力融合区域上下文,提升预测准确率
  • 适合病理图像与空间转录组联合分析的研究者

空间转录组学(ST)连接基因表达与组织形态,但因技术复杂和成本高昂难以临床应用。现有计算方法虽可从H&E染色全切片图像(WSI)预测基因表达,却常忽略斑点内生物异质性,且在整合周围组织上下文时易受形态噪声干扰。为此,我们提出HiFusion,一种结合双组件的深度学习框架:首先设计分层斑点内建模模块,通过多分辨率子块分解提取细粒度形态特征,并以特征对齐损失保证跨尺度语义一致性;其次提出上下文感知跨尺度融合模块,利用交叉注意力机制选择性引入生物学相关区域上下文,增强表征能力。该架构可全面建模细胞级特征与组织微环境信号,显著提升基因表达预测性能。在两个基准ST数据集上的实验证明,HiFusion在2D滑动窗口交叉验证和更具挑战性的3D样本专属场景中均达当前最优水平,展现出作为常规病理切片空间转录组推断鲁棒、精准、可扩展解决方案的潜力。

原文摘要 · Abstract (English)

Spatial transcriptomics (ST) bridges gene expression and tissue morphology but faces clinical adoption barriers due to technical complexity and prohibitive costs. While computational methods predict gene expression from H&E-stained whole-slide images (WSIs), existing approaches often fail to capture the intricate biological heterogeneity within spots and are susceptible to morphological noise when integrating contextual information from surrounding tissue. To overcome these limitations, we propose HiFusion, a novel deep learning framework that integrates two complementary components. First, we introduce the Hierarchical Intra-Spot Modeling module that extracts fine-grained morphological representations through multi-resolution sub-patch decomposition, guided by a feature alignment loss to ensure semantic consistency across scales. Concurrently, we present the Context-aware Cross-scale Fusion module, which employs cross-attention to selectively incorporate biologically relevant regional context, thereby enhancing representational capacity. This architecture enables comprehensive modeling of both cellular-level features and tissue microenvironmental cues, which are essential for accurate gene expression prediction. Extensive experiments on two benchmark ST datasets demonstrate that HiFusion achieves state-of-the-art performance across both 2D slide-wise cross-validation and more challenging 3D sample-specific scenarios. These results underscore HiFusion's potential as a robust, accurate, and scalable solution for ST inference from routine histopathology.

空间转录组病理图像深度学习基因表达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。