提出医疗联邦学习压力测试框架,揭示模型在不同医院的性能差异风险
MedFL-Stress: A Systematic Robustness Evaluation of Federated Brain Tumor Segmentation under Cross-Hospital MRI Appearance Shift
- 构建可控压力测试框架,模拟多中心磁共振成像外观差异
- 发现主流方法平均精度高但个别医院表现差(差距达0.0850 Dice)
- FedBN显著降低医院间差异,适合临床部署可靠性评估
联邦学习使医院可在不共享患者数据的情况下协同训练分割模型。然而,当前评估仅报告客户端平均性能,掩盖了个别机构的失败风险。临床部署中,某医院持续失效是重大安全隐患,而平均分可能完全掩盖此问题。我们提出MedFL-Stress,一个受控的压力测试框架,专门暴露此类失效模式。基于BraTS 2020的四组模拟医院客户端的2D轴向切片,施加渐进式MRI外观偏移(伽马对比度、尺度偏移、噪声加模糊),反映真实多中心部署中的扫描仪与采集差异。评估三种联邦基线:FedAvg、FedProx和FedBN。最差医院的Dice分数及医院间差异作为核心指标,而非附加观察。FedAvg取得最高全局平均Dice(0.8159),但其最优与最差医院间存在0.0850的差距。FedBN将该差距缩小41%(从0.0850降至0.0503),同时平均精度仅下降不足0.005(0.8159降至0.8109),最弱医院的性能直接提升3.5 Dice点(0.7309升至0.7656)。结果表明,面向鲁棒性的评估协议对可靠联邦医学影像部署至关重要。
原文摘要 · Abstract (English)
Federated learning enables hospitals to collaboratively train segmentation models without sharing patient data. However, current evaluation protocols report only average performance across clients, masking failures at individual sites. In clinical deployment, a model that fails consistently at one hospital is a real safety risk that a good mean score can hide entirely. We introduce MedFL-Stress, a controlled stress-testing framework that exposes exactly this failure mode. Using 2D axial slices from BraTS 2020 distributed across four simulated hospital clients, we apply graded MRI appearance shifts (gamma contrast, scale-shift, and noise-plus-blur) reflecting scanner and acquisition variability in real multi-site deployments. Three federated baselines are evaluated: FedAvg, FedProx, and FedBN. Worst-hospital Dice and inter-hospital disparity are treated as primary metrics, not supplementary observations. FedAvg achieves the highest global mean Dice (0.8159) but conceals a 0.0850 gap between its best and worst-performing hospital. FedBN closes that gap by 41% (0.0850 to 0.0503) while sacrificing less than half a Dice point in mean accuracy (0.8159 to 0.8109), and the weakest hospital gains 3.5 Dice points outright (0.7309 to 0.7656). These findings demonstrate that robustness-oriented evaluation protocols are essential for reliable federated medical imaging deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。