用图神经网络融合组织图像多尺度特征,提升病理切片基因表达预测精度。
MERGE: Multi-faceted Hierarchical Graph-based GNN for Gene Expression Prediction from Whole Slide Histopathology Images
- 构建多维度分层图,连接不同位置的组织区域以捕捉远距离交互
- 在多个指标上超越当前最优方法,显著提升基因表达预测准确率
- 适合从事病理图像分析与空间转录组研究的科研人员
近期空间转录组技术将组织学图像与空间解析的基因表达谱相结合,可根据图像块预测不同组织位置的基因表达,为全切片图像(WSI)任务提供了局部基因表达信息。然而,现有方法未能充分挖掘不同组织位置间的相互作用,这影响了联合预测的准确性。为此,我们提出MERGE(多维度分层图基因表达预测模型),结合多维度分层图构建策略与图神经网络(GNN),以提升从全切片图像中预测基因表达的能力。通过基于空间和形态特征对组织图像块进行聚类,并引入簇内与簇间边,模型在GNN学习过程中增强了远距离组织区域间的交互。此外,我们评估了多种数据平滑技术,以缓解空间转录组数据中的技术伪影问题。结果表明,采用更具生物学意义的基因感知平滑方法更为有效。实验结果显示,该GNN方法在多个评价指标上均优于现有最先进技术。
原文摘要 · Abstract (English)
Recent advances in Spatial Transcriptomics (ST) pair histology images with spatially resolved gene expression profiles, enabling predictions of gene expression across different tissue locations based on image patches. This opens up new possibilities for enhancing whole slide image (WSI) prediction tasks with localized gene expression. However, existing methods fail to fully leverage the interactions between different tissue locations, which are crucial for accurate joint prediction. To address this, we introduce MERGE (Multi-faceted hiErarchical gRaph for Gene Expressions), which combines a multi-faceted hierarchical graph construction strategy with graph neural networks (GNN) to improve gene expression predictions from WSIs. By clustering tissue image patches based on both spatial and morphological features, and incorporating intra- and inter-cluster edges, our approach fosters interactions between distant tissue locations during GNN learning. As an additional contribution, we evaluate different data smoothing techniques that are necessary to mitigate artifacts in ST data, often caused by technical imperfections. We advocate for adopting gene-aware smoothing methods that are more biologically justified. Experimental results on gene expression prediction show that our GNN method outperforms state-of-the-art techniques across multiple metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。