arXiv:2603.10967cs.CV2026-03

提出轻量级联邦微调框架,实现3D心脏MRI模型高效个性化训练。

Med-DualLoRA: Local Adaptation of Foundation Models for 3D Cardiac MRI

  • 分离全局与本地低秩适配器,仅上传全局参数
  • 仅微调两个Transformer块即保持性能,通信量大幅降低
  • 适合医疗数据隐私受限场景,支持多中心协同

基础模型(FMs)在心脏磁共振(CMR)等医学影像任务中表现优异,但单中心数据微调易引入偏差,而集中式训练受隐私限制难以实施。联邦微调可解决隐私问题,但传统方法在异质、非独立同分布的多中心数据下表现不佳,且大模型通信开销高。本文提出Med-DualLoRA,一种客户端感知的参数高效微调联邦框架,通过加法分解将全局共享与本地低秩适配(LoRA)解耦。全局与本地LoRA在客户端本地训练,仅聚合并更新全局组件,本地适配器保持私有。该设计提升个性化能力并显著降低通信成本。实验表明,仅微调两个Transformer块即可维持性能,同时提升效率。在ACDC与联合M&M数据集上评估,采用不同厂商作为联邦客户端,Med-DualLoRA在疾病检测任务中达到0.768的平衡准确率和0.612的特异性,优于其他联邦PEFT基线,且通信效率更高。该方法为真实临床环境下医疗基础模型的本地联邦适配提供了可扩展解决方案。

原文摘要 · Abstract (English)

Foundation models (FMs) show great promise for robust downstream performance across medical imaging tasks and modalities, including cardiac magnetic resonance (CMR), following task-specific adaptation. However, adaptation using single-site data may lead to suboptimal performance and increased model bias, while centralized fine-tuning on clinical data is often infeasible due to privacy constraints. Federated fine-tuning offers a privacy-preserving alternative; yet conventional approaches struggle under heterogeneous, non-IID multi-center data and incur substantial communication overhead when adapting large models. In this work, we study federated FM fine-tuning for 3D CMR disease detection and propose Med-DualLoRA, a client-aware parameter-efficient fine-tuning (PEFT) federated framework that disentangles globally shared and local low-rank adaptations (LoRA) through additive decomposition. Global and local LoRA modules are trained locally, but only the global component is shared and aggregated across sites, keeping local adapters private. This design improves personalization while significantly reducing communication cost, and experiments show that adapting only two transformer blocks preserves performance while further improving efficiency. We evaluate our method on a multi-center state-of-the-art cine 3D CMR FM fine-tuned for disease detection using ACDC and combined M\&Ms datasets, treating each vendor as a federated client. Med-DualLoRA achieves statistically significant improved performance (balanced accuracy 0.768, specificity 0.612) compared to other federated PEFT baselines, while maintaining communication efficiency. Our approach provides a scalable solution for local federated adaptation of medical FMs under realistic clinical constraints.

联邦学习医疗影像参数高效3D MRI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。