arXiv:2609.02101cs.LGcs.AI2026-09

跨四国胸片数据联邦微调医学视觉语言模型,提升诊断准确率。

Federated LoRA Adaptation of BiomedCLIP Across Four International Chest X-Ray Cohorts

论文配图:Federated LoRA Adaptation of BiomedCLIP Across Four International Chest X-Ray Cohorts
图 1 · 摘自论文原文
  • 用低秩适配(LoRA)实现跨机构联邦学习,只传小量参数更新。
  • 平均AUC从0.687提升至0.802,最弱数据集提升显著,接近集中训练的0.812。
  • 采用SVD-based聚合方法能有效融合异构数据,适合医疗多中心协作。

联邦学习让机构在不共享数据的前提下协同训练模型,低秩适配(LoRA)通过仅传输紧凑的低秩更新,使规模化应用成为可能。医学影像领域尤其适合:患者数据受隐私法规保护,且各机构设备、协议和算力差异大。这种异质性带来关键问题:如何聚合联邦LoRA更新?我们对BiomedCLIP在四个跨越三大洲(美、越、西)的公开胸片队列上进行联邦参数高效微调(PEFT)基准测试。联邦LoRA适应使所有四组队列的共享分类AUC均高于未适应的BiomedCLIP主干(均值从0.687升至0.802),表明增益来自联邦适应而非预训练模型的零样本能力。相比单队列独立训练,联邦学习提升了较弱队列表现,同时基本保留最强队列性能,并逼近集中式参考结果(0.812)。由FlexLoRA提出的基于奇异值分解(SVD)的乘积空间聚合方法对这一提升至关重要(简单因子平均使均值AUC下降0.097),而漂移修正优化器(FedProx)在单种子运行中未优于FedAvg,与LoRA低秩更新本身已限制客户端漂移一致。因此,无需中央化数据,即可在异构、地理分布的机构间协作适配生物医学视觉-语言模型。

原文摘要 · Abstract (English)

Federated learning (FL) lets institutions train a shared model without exchanging data, and Low-Rank Adaptation (LoRA) makes this practical at scale by communicating only compact low-rank updates. Biomedical imaging is a compelling setting for this combination: patient data are archived behind privacy regulations, and institutions differ widely in scanners, protocols, and compute. Such heterogeneity raises the question of how federated LoRA updates should be aggregated, increasingly pressing as multimodal vision-language models become central to medical image analysis. We benchmark federated Parameter-efficient fine-tuning (PEFT) of BiomedCLIP for chest radiograph classification across four public cohorts on three continents (USA, Vietnam, Spain). Federated LoRA adaptation improves shared-class AUC on all four cohorts over the unadapted BiomedCLIP backbone (mean 0.687 to 0.802), showing that the gains come from federated adaptation rather than from the pretrained model's zero-shot ability. Relative to isolated single-cohort training, federation improves the weaker cohorts while largely preserving the strongest and approaches a centralized reference (0.812) that pools all data. The singular value decomposition (SVD)-based product-space aggregation introduced by FlexLoRA is essential to this gain (naive factor averaging drops mean AUC by 0.097), whereas a drift-correcting optimizer (FedProx) shows no benefit over FedAvg in our single-seed runs, consistent with LoRA's low-rank updates already limiting client drift. Biomedical vision-language models can thus be adapted collaboratively across heterogeneous, geographically distributed institutions without centralizing data.

联邦学习医学影像低秩适配多中心研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。