arXiv:2505.02529eess.IVcs.CV2025-05被引 3

用向量量化提升癌症生存预测的抗噪能力,跨中心数据更稳定。

RobSurv: Vector Quantization-Based Multi-Modal Learning for Robust Cancer Survival Prediction

  • 双路径设计:离散代码本+连续特征并行处理,兼顾鲁棒性与细节
  • 三组数据集上C-index达0.771~0.734,显著优于现有方法
  • 在强噪声下性能下降仅3.8-4.5%,适合临床多中心应用

基于多模态医学影像的癌症生存预测在肿瘤学中面临重大挑战,主要源于深度学习模型对噪声和不同影像中心扫描协议差异的敏感性。当前方法难以从异构的CT和PET图像中提取一致特征,限制了其临床可用性。本文提出RobSurv,一种基于向量量化实现鲁棒多模态特征学习的深度学习框架。其核心创新在于双路径架构:一条路径将连续影像特征映射至学习到的离散代码本,实现抗噪表征;另一条路径通过连续特征处理保留细粒度信息。两种表示通过新型局部融合机制整合,结合Transformer捕获全局上下文的同时保持局部空间关系。在三个多样化数据集(HECKTOR、H&N1和NSCLC Radiogenomics)上的广泛评估显示,RobSurv分别取得0.771、0.742和0.734的C-index,显著优于现有方法。尤为突出的是,模型在严重噪声条件下性能仅下降3.8-4.5%,而基线方法下降8-12%。这些结果结合跨癌种与成像协议的良好泛化能力,表明RobSurv是可靠临床预后预测的有前景方案,有助于优化治疗规划与患者照护。

原文摘要 · Abstract (English)

Cancer survival prediction using multi-modal medical imaging presents a critical challenge in oncology, mainly due to the vulnerability of deep learning models to noise and protocol variations across imaging centers. Current approaches struggle to extract consistent features from heterogeneous CT and PET images, limiting their clinical applicability. We address these challenges by introducing RobSurv, a robust deep-learning framework that leverages vector quantization for resilient multi-modal feature learning. The key innovation of our approach lies in its dual-path architecture: one path maps continuous imaging features to learned discrete codebooks for noise-resistant representation, while the parallel path preserves fine-grained details through continuous feature processing. This dual representation is integrated through a novel patch-wise fusion mechanism that maintains local spatial relationships while capturing global context via Transformer-based processing. In extensive evaluations across three diverse datasets (HECKTOR, H\&N1, and NSCLC Radiogenomics), RobSurv demonstrates superior performance, achieving concordance index of 0.771, 0.742, and 0.734 respectively - significantly outperforming existing methods. Most notably, our model maintains robust performance even under severe noise conditions, with performance degradation of only 3.8-4.5\% compared to 8-12\% in baseline methods. These results, combined with strong generalization across different cancer types and imaging protocols, establish RobSurv as a promising solution for reliable clinical prognosis that can enhance treatment planning and patient care.

癌症预测多模态学习向量量化鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。