arXiv:2602.04416cs.CVcs.AI2026-02被引 1

首个医疗多模态联邦学习基准,支持多种模态与任务的隐私保护协作训练。

Med-MMFL: A Multimodal Federated Learning Benchmark in Healthcare

  • 构建涵盖2-4种医学模态的多模态联邦学习评估框架。
  • 覆盖10种医学模态,测试6种主流联邦算法在真实异构场景下的表现。
  • 适合研究医疗联邦学习、多模态模型融合与隐私保护技术的学者使用。

联邦学习(FL)可在保护数据隐私的前提下实现跨分散医疗机构的协同模型训练。然而,当前医疗联邦学习基准仍十分稀缺,现有工作主要集中在单模态或双模态,且任务范围有限。这一空白凸显了建立标准化评估体系以推动医疗多模态联邦学习(MMFL)系统性发展的必要性。为此,我们提出了首个面向医疗领域的综合性多模态联邦学习基准——Med-MMFL,涵盖多样化模态、任务与联邦场景。该基准评估了六种代表性的先进联邦学习算法,涵盖不同聚合策略、损失函数与正则化技术。数据集包含2至4种模态,共10种独特医学模态,包括文本、病理图像、心电图(ECG)、X光片、放射科报告及多种磁共振序列。实验在自然联邦、合成独立同分布(IID)与非独立同分布(non-IID)设置下进行,以模拟现实世界异质性。评估任务包括分割、分类、模态对齐(检索)和视觉问答(VQA)。为支持未来方法在真实医疗环境下的可复现性与公平比较,我们已开源完整基准实现,包括数据处理与划分流程,详见 https://github.com/bhattarailab/Med-MMFL-Benchmark。

原文摘要 · Abstract (English)

Federated learning (FL) enables collaborative model training across decentralized medical institutions while preserving data privacy. However, medical FL benchmarks remain scarce, with existing efforts focusing mainly on unimodal or bimodal modalities and a limited range of medical tasks. This gap underscores the need for standardized evaluation to advance systematic understanding in medical MultiModal FL (MMFL). To this end, we introduce Med-MMFL, the first comprehensive MMFL benchmark for the medical domain, encompassing diverse modalities, tasks, and federation scenarios. Our benchmark evaluates six representative state-of-the-art FL algorithms, covering different aggregation strategies, loss formulations, and regularization techniques. It spans datasets with 2 to 4 modalities, comprising a total of 10 unique medical modalities, including text, pathology images, ECG, X-ray, radiology reports, and multiple MRI sequences. Experiments are conducted across naturally federated, synthetic IID, and synthetic non-IID settings to simulate real-world heterogeneity. We assess segmentation, classification, modality alignment (retrieval), and VQA tasks. To support reproducibility and fair comparison of future multimodal federated learning (MMFL) methods under realistic medical settings, we release the complete benchmark implementation, including data processing and partitioning pipelines, at https://github.com/bhattarailab/Med-MMFL-Benchmark .

联邦学习多模态医疗AI隐私计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。