筛选高质量模态融合,提升前列腺癌复发预测准确率
Synergy vs. Noise: Performance-Guided Multimodal Fusion For Biochemical Recurrence-Free Survival in Prostate Cancer
- 按预测性能优劣选择模态,避免低质数据引入噪声
- 高表现模态组合比单模态提升预测精度,差模态则导致性能下降
- 适用于医疗影像与病理多模态建模,指导模型设计
多模态深度学习(MDL)在计算病理学中展现出变革性潜力,通过整合来自不同数据源的互补信息,在多种临床任务中优于单模态模型。然而,假设融合模态必然提升性能仍未被充分验证。本文提出:多模态增益取决于各模态自身的预测质量,将弱表现模态引入可能带来噪声而非互补信息。我们在包含组织病理、影像和临床数据的前列腺癌数据集上,针对生化复发时间进行预测。结果表明,高表现模态组合显著优于单模态;而将低表现模态与高表现模态融合,反而降低预测准确性。研究证实,多模态优势需基于性能导向的选择性整合,而非盲目组合,对计算病理与医学影像中的MDL设计具有重要启示。
原文摘要 · Abstract (English)
Multimodal deep learning (MDL) has emerged as a transformative approach in computational pathology. By integrating complementary information from multiple data sources, MDL models have demonstrated superior predictive performance across diverse clinical tasks compared to unimodal models. However, the assumption that combining modalities inherently improves performance remains largely unexamined. We hypothesise that multimodal gains depend critically on the predictive quality of individual modalities, and that integrating weak modalities may introduce noise rather than complementary information. We test this hypothesis on a prostate cancer dataset with histopathology, radiology, and clinical data to predict time-to-biochemical recurrence. Our results confirm that combining high-performing modalities yield superior performance compared to unimodal approaches. However, integrating a poor-performing modality with other higher-performing modalities degrades predictive accuracy. These findings demonstrate that multimodal benefit requires selective, performance-guided integration rather than indiscriminate modality combination, with implications for MDL design across computational pathology and medical imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。