arXiv:2507.14670cs.CV2025-07中稿 · The IEEE/CVF Winte…被引 1

通过双路径多层级判别,提升病理图像预测基因表达的准确性。

Gene-DML: Dual-Pathway Multi-Level Discrimination for Gene Expression Prediction from Histopathology Images

  • 设计双路径结构,分别处理局部与整体层级的跨模态对齐。
  • 在多个公开空间转录组数据集上达到当前最佳预测效果。
  • 适合从事计算病理学与精准医学研究的科研人员参考。

从病理图像准确预测基因表达为分子分型提供了可扩展且非侵入性的方法,对精准医学和计算病理学具有重要意义。然而,现有方法常未能充分利用病理图像与基因表达在多个表征层次上的跨模态对齐,限制了预测性能。为此,我们提出Gene-DML,一种通过双路径多层级判别构建潜在空间的统一框架,以增强形态学与转录组模态之间的对应关系。多尺度实例级判别路径将局部、邻域和全局层次提取的病理图像表示与基因表达谱对齐,捕捉尺度感知的形态-转录关联。并行的跨层级实例-组判别路径则强制个体(图像/基因)实例与跨模态组(基因/图像)之间保持结构一致性,强化跨模态对齐。通过联合建模细粒度与结构级判别,Gene-DML能够学习鲁棒的跨模态表示,在多样生物学背景下显著提升预测准确率与泛化能力。在多个公开空间转录组数据集上的大量实验表明,Gene-DML在基因表达预测任务中达到当前最优性能。代码与处理后的数据集已发布于https://github.com/YXSong000/Gene-DML。

原文摘要 · Abstract (English)

Accurately predicting gene expression from histopathology images offers a scalable and non-invasive approach to molecular profiling, with significant implications for precision medicine and computational pathology. However, existing methods often underutilize the cross-modal representation alignment between histopathology images and gene expression profiles across multiple representational levels, thereby limiting their prediction performance. To address this, we propose Gene-DML, a unified framework that structures latent space through Dual-pathway Multi-Level discrimination to enhance correspondence between morphological and transcriptional modalities. The multi-scale instance-level discrimination pathway aligns hierarchical histopathology representations extracted at local, neighbor, and global levels with gene expression profiles, capturing scale-aware morphological-transcriptional relationships. In parallel, the cross-level instance-group discrimination pathway enforces structural consistency between individual (image/gene) instances and modality-crossed (gene/image, respectively) groups, strengthening the alignment across modalities. By jointly modeling fine-grained and structural-level discrimination, Gene-DML is able to learn robust cross-modal representations, enhancing both predictive accuracy and generalization across diverse biological contexts. Extensive experiments on public spatial transcriptomics datasets demonstrate that Gene-DML achieves state-of-the-art performance in gene expression prediction. The code and processed datasets are available at https://github.com/YXSong000/Gene-DML.

基因表达病理图像跨模态深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。