arXiv:2602.21399cs.LGcs.AI2026-02中稿 · CVPR

用全局验证集梯度指导聚合,提升异构数据下的联邦学习性能

FedVG: Gradient-Guided Aggregation for Enhanced Federated Learning

  • 基于层间验证梯度幅值评估客户端泛化能力,动态调整聚合权重
  • 在图像分类与医学影像数据集上,异构场景下准确率提升最高达6.2%
  • 可插拔集成现有联邦算法,适用于医疗、视觉等隐私敏感领域

联邦学习(FL)允许多个客户端在不共享私有数据的前提下协同训练模型。然而,客户端间的数据异构性会导致客户端漂移,降低模型整体泛化性能,且对表现较差客户端的过度依赖进一步加剧此问题。为此,我们提出FedVG——一种基于梯度的联邦聚合新框架,利用公开可用的全局验证集引导优化过程,确保各客户端间的一致性与隐私安全。与传统依赖数据量的方法不同,FedVG通过测量各层验证梯度的范数,计算反映客户端改进泛化能力所需调整程度的专属评分,实现更智能的聚合策略。在自然图像和医学影像基准数据集上,跨多种模型架构的大量实验表明,FedVG在高度异构设置下持续提升性能,最高提升6.2%。此外,该方法模块化设计,可无缝集成至各类前沿联邦学习算法,常带来额外性能增益。代码已开源:https://github.com/alinadevkota/FedVG。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client drift, which degrades the overall generalization performance of the model. This effect is further compounded by overemphasis on poorly performing clients. To address this problem, we propose FedVG, a novel gradient-based federated aggregation framework that leverages a global validation set to guide the optimization process. Such a global validation set can be established using readily available public datasets, ensuring accessibility and consistency across clients without compromising privacy. In contrast to conventional approaches that prioritize client dataset volume, FedVG assesses the generalization ability of client models by measuring the magnitude of validation gradients across layers. Specifically, we compute layerwise gradient norms to derive a client-specific score that reflects how much each client needs to adjust for improved generalization on the global validation set, thereby enabling more informed and adaptive federated aggregation. Extensive experiments on both natural and medical image benchmarking datasets, across diverse model architectures, demonstrate that FedVG consistently improves performance, particularly in highly heterogeneous settings. Moreover, FedVG is modular and can be seamlessly integrated with various state-of-the-art FL algorithms, often further improving their results. Our code is available at https://github.com/alinadevkota/FedVG.

联邦学习梯度聚合异构数据医疗影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。