用低秩适配优化联邦学习,提升心脏核磁分割精度并降带宽
Rate-My-LoRA: Efficient and Adaptive Federated Model Tuning for Cardiac MRI Segmentation
- 用LoRA压缩模型更新,减少通信开销
- 自适应加权聚合,提升跨医院数据泛化能力
- 适合医疗联邦学习场景,尤其数据异构的医院合作
心血管疾病和心律失常是美国主要公共卫生问题。精确的心脏图像分割对提取量化指标、分类心律失常至关重要。但高精度通常依赖集中多个医院的大规模数据,面临隐私挑战。为此,本文提出一种高效自适应的联邦学习方法,用于心脏分割,在不共享敏感数据的前提下提升模型性能并降低带宽消耗。该方法利用低秩适配(LoRA)正则化模型权重更新,减少通信开销;提出一种新型聚合策略,通过比较各客户端验证准确率,自适应惩罚不同客户端的聚合权重,实现更好的泛化性能与快速本地适应。在公开心脏磁共振数据集上的单客户端与跨客户端评估表明,本方法优于其他基于LoRA的联邦学习方案。
原文摘要 · Abstract (English)
Cardiovascular disease (CVD) and cardiac dyssynchrony are major public health problems in the United States. Precise cardiac image segmentation is crucial for extracting quantitative measures that help categorize cardiac dyssynchrony. However, achieving high accuracy often depends on centralizing large datasets from different hospitals, which can be challenging due to privacy concerns. To solve this problem, Federated Learning (FL) is proposed to enable decentralized model training on such data without exchanging sensitive information. However, bandwidth limitations and data heterogeneity remain as significant challenges in conventional FL algorithms. In this paper, we propose a novel efficient and adaptive federate learning method for cardiac segmentation that improves model performance while reducing the bandwidth requirement. Our method leverages the low-rank adaptation (LoRA) to regularize model weight update and reduce communication overhead. We also propose a \mymethod{} aggregation technique to address data heterogeneity among clients. This technique adaptively penalizes the aggregated weights from different clients by comparing the validation accuracy in each client, allowing better generalization performance and fast local adaptation. In-client and cross-client evaluations on public cardiac MR datasets demonstrate the superiority of our method over other LoRA-based federate learning approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。