arXiv:2603.16421cs.CV2026-03中稿 · IEEE ICME 2026

用生成的蛋白特征融合病理图像,提升癌症生存风险预测准确率

HGP-Mamba: Integrating Histology and Generated Protein Features for Mamba-based Multimodal Survival Risk Prediction

  • 通过预训练模型从病理切片生成蛋白嵌入,低成本融合分子信息
  • 在4个公开数据集上表现超越现有方法,计算效率更高
  • 适合关注多模态医学分析与生存预测的研究者

多模态学习的进展显著提升了癌症生存风险预测能力。然而,蛋白标志物与组织病理图像的联合预后潜力尚未充分挖掘,主要受限于蛋白表达谱的高成本和数据稀缺性。为此,我们提出HGP-Mamba,一种基于Mamba的多模态框架,高效融合组织学特征与生成的蛋白特征以进行生存风险预测。具体地,引入蛋白特征提取器(PFE),利用预训练基础模型直接从全切片图像(WSIs)中推导高通量蛋白嵌入,实现分子信息的数据高效整合。结合捕捉形态模式的组织学嵌入,进一步设计局部交互感知Mamba(LiAM)以实现细粒度特征交互,以及全局交互增强Mamba(GiEM)以促进整张切片层面的模态融合,从而捕获复杂的跨模态依赖关系。在四个公开癌症数据集上的实验表明,HGP-Mamba在保持优异计算效率的同时达到当前最优性能。源代码已公开:https://github.com/Daijing-ai/HGP-Mamba.git。

原文摘要 · Abstract (English)

Recent advances in multimodal learning have significantly improved cancer survival risk prediction. However, the joint prognostic potential of protein markers and histopathology images remains underexplored, largely due to the high cost and limited availability of protein expression profiling. To address this challenge, we propose HGP-Mamba, a Mamba-based multimodal framework that efficiently integrates histological with generated protein features for survival risk prediction. Specifically, we introduce a protein feature extractor (PFE) that leverages pretrained foundation models to derive high-throughput protein embeddings directly from Whole Slide Images (WSIs), enabling data-efficient incorporation of molecular information. Together with histology embeddings that capture morphological patterns, we further introduce the Local Interaction-aware Mamba (LiAM) for fine-grained feature interaction and the Global Interaction-enhanced Mamba (GiEM) to promote holistic modality fusion at the slide level, thus capture complex cross-modal dependencies. Experiments on four public cancer datasets demonstrate that HGP-Mamba achieves state-of-the-art performance while maintaining superior computational efficiency compared with existing methods. Our source code is publicly available at https://github.com/Daijing-ai/HGP-Mamba.git.

多模态学习生存预测病理图像Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。