arXiv:2504.07061cs.CV2025-04被引 6

用高效方法让病理模型精准预测基因表达,提升癌症研究准确性

Teaching pathology foundation models to accurately predict gene expression with parameter efficient knowledge transfer

  • 通过块仿射适配与知识蒸馏实现跨模态知识迁移
  • 在20万张组织切片上提升基因表达预测准确率至少5%
  • 适合关注病理与基因关联、追求低成本微调的研究者

基因表达谱对理解细胞异质性、生物过程及疾病机制至关重要。近年来,从数字化病理图像直接预测基因表达的计算方法受到广泛关注。尽管图像基础模型在多种病理下游任务中表现良好,但在基因表达预测上的性能仍有限。显式引入转录组模型信息可缓解领域偏移问题,但基础模型的微调与对齐成本高昂。本文提出参数高效知识迁移(PEKA)框架,结合块仿射适配、知识蒸馏与结构对齐损失,实现跨模态知识传递。我们在多个空间转录组数据集(共包含206,123张匹配基因表达的图像切片,涵盖多种组织类型)上评估了PEKA在基因表达预测中的表现,结果表明其性能较基线基础模型至少提升5%,且优于其他参数高效微调策略。论文将在同行评审后公开代码、数据集与对齐模型,以促进参数高效模型对齐的广泛应用与进一步发展。

原文摘要 · Abstract (English)

Gene expression profiling provides critical insights into cellular heterogeneity, biological processes and disease mechanisms. There has been an increasing interest in computational approaches that can predict gene expression directly from digitalized histopathology images. While image foundation models have shown promise in a variety of pathology downstream analysis, their performances on gene-expression prediction are still limited. Explicitly incorporating information from the transcriptomic models can help image models to address domain shift, yet the fine-tuning and alignment of foundation models can be expensive. In the work, we propose Parameter Efficient Knowledge trAnsfer (PEKA), a novel framework that leverages Block-Affine Adaptation and integrates knowledge distillation and structure alignment losses for cross-modal knowledge transfer. We evaluated PEKA for gene expression prediction using multiple spatial transcriptomics datasets (comprising 206,123 image tiles with matched gene expression profiles) that encompassed various types of tissue. PEKA achieved at least 5\% performance improvement over baseline foundation models while also outperforming alternative parameter-efficient fine-tuning strategies. We will release the code, datasets and aligned models after peer-review to facilitate broader adoption and further development for parameter efficient model alignment.

基因表达病理图像知识迁移参数高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。