针对多脉冲MRI分类,提出高效个性化联邦学习方法,解决数据异构与通信开销问题。
CEPerFed: Communication-Efficient Personalized Federated Learning for Multi-Pulse MRI Classification
- 利用客户端历史梯度协调本地与全局优化,缓解数据异构影响
- 通过分层奇异值分解仅传输关键模型信息,降低通信开销
- 适用于医疗影像跨机构协作,尤其适合资源受限场景
多脉冲磁共振成像(MRI)广泛应用于阿尔茨海默病等临床诊断。为训练鲁棒的多脉冲MRI分类模型,需整合多个医疗机构的大规模多样化数据,同时保护隐私、避免原始数据共享。尽管联邦学习(FL)是可行方案,但数据异构性导致模型收敛困难,且大量参数传输带来显著通信开销。为此,本文提出通信高效的个性化联邦学习方法CEPerFed。该方法通过引入客户端历史风险梯度与历史均值梯度,协调本地与全局优化:前者用于加权其他客户端贡献,提升本地更新可靠性;后者确保本地更新与全局优化方向一致,保障异构数据下的稳定收敛。为降低通信开销,提出分层奇异值分解(HSVD)策略,仅传输模型更新所需的关键信息。在五个分类任务上的实验验证了该方法的有效性。代码将在论文录用后公开于https://github.com/LD0416/CEPerFed。
原文摘要 · Abstract (English)
Multi-pulse magnetic resonance imaging (MRI) is widely utilized for clinical practice such as Alzheimer's disease diagnosis. To train a robust model for multi-pulse MRI classification, it requires large and diverse data from various medical institutions while protecting privacy by preventing raw data sharing across institutions. Although federated learning (FL) is a feasible solution to address this issue, it poses challenges of model convergence due to the effect of data heterogeneity and substantial communication overhead due to large numbers of parameters transmitted within the model. To address these challenges, we propose CEPerFed, a communication-efficient personalized FL method. It mitigates the effect of data heterogeneity by incorporating client-side historical risk gradients and historical mean gradients to coordinate local and global optimization. The former is used to weight the contributions from other clients, enhancing the reliability of local updates, while the latter enforces consistency between local updates and the global optimization direction to ensure stable convergence across heterogeneous data distributions. To address the high communication overhead, we propose a hierarchical SVD (HSVD) strategy that transmits only the most critical information required for model updates. Experiments on five classification tasks demonstrate the effectiveness of the CEPerFed method. The code will be released upon acceptance at https://github.com/LD0416/CEPerFed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。