隐私保护下融合多模态数据,实现带置信度的生存预测。
BVFLMSP : Bayesian Vertical Federated Learning for Multimodal Survival with Privacy
- 基于贝叶斯垂直联邦学习框架,客户端独立建模各模态数据。
- 相比中心化模型,C-index最高提升0.02,且在严格隐私约束下仍有效。
- 适用于医疗多源数据协作场景,提供可解释的预测不确定性。
多模态生存分析常需整合分布于多方的敏感数据,集中式训练受隐私限制难以实施。现有模型多输出确定性预测,缺乏置信度信息,影响实际决策可靠性。为此,我们提出BVFLMSP,一种基于分裂神经网络的贝叶斯垂直联邦学习框架,用于多模态生存分析。各客户端使用贝叶斯神经网络独立建模特定数据模态,中央服务器聚合中间表示进行生存风险预测。为增强隐私,通过扰动客户端表示引入差分隐私机制,提供正式隐私保障。实验表明,该方法在多模态设置下持续优于单模态基线及中心化多模态模型MultiSurv,C-index最高提升0.02;在不同隐私预算下对比联邦与集中学习,揭示预测性能与隐私间的权衡。结果证明,BVFLMSP能有效融合多模态数据,在严格隐私约束下保持鲁棒性,并提供不确定性估计。
原文摘要 · Abstract (English)
Multimodal time-to-event prediction often requires integrating sensitive data distributed across multiple parties, making centralized model training impractical due to privacy constraints. At the same time, most existing multimodal survival models produce single deterministic predictions without indicating how confident the model is in its estimates, which can limit their reliability in real-world decision making. To address these challenges, we propose BVFLMSP, a Bayesian Vertical Federated Learning (VFL) framework for multimodal time-to-event analysis based on a Split Neural Network architecture. In BVFLMSP, each client independently models a specific data modality using a Bayesian neural network, while a central server aggregates intermediate representations to perform survival risk prediction. To enhance privacy, we integrate differential privacy mechanisms by perturbing client side representations before transmission, providing formal privacy guarantees against information leakage during federated training. We first evaluate our Bayesian multimodal survival model against widely used single modality survival baselines and the centralized multimodal baseline MultiSurv. Across multimodal settings, the proposed method shows consistent improvements in discrimination performance, with up to 0.02 higher C-index compared to MultiSurv. We then compare federated and centralized learning under varying privacy budgets across different modality combinations, highlighting the tradeoff between predictive performance and privacy. Experimental results show that BVFLMSP effectively includes multimodal data, improves survival prediction over existing baselines, and remains robust under strict privacy constraints while providing uncertainty estimates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。