通过客户端向量自适应调整聚合权重,提升联邦学习稳定性。
FedAWA: Adaptive Optimization of Aggregation Weights in Federated Learning Using Client Vectors
- 用客户端模型更新方向作为向量,动态优化聚合权重。
- 在多种异构场景下收敛更稳,性能优于传统按数据量加权方法。
- 无需额外数据即可实现安全自适应,适合隐私敏感场景。
联邦学习(FL)为分布式机器学习提供了一种前景广阔的框架,可在不共享本地数据的前提下协同训练模型,从而保护隐私并增强安全性。然而,由于用户行为、偏好及设备特性差异导致的数据异构性,给联邦学习带来显著挑战。以往多数工作忽视聚合权重的调整,仅依赖数据集大小分配权重,常导致收敛不稳定和模型性能下降。近期一些研究尝试通过引入数据集特征和模型对齐来改进聚合策略,但如何在不使用额外代理数据且不违反隐私的前提下自适应调整聚合权重,仍是重大挑战。本文提出一种新的联邦学习自适应加权聚合方法(FedAWA),基于客户端向量在学习过程中动态调整聚合权重。客户端向量捕捉模型更新的方向,反映局部数据变化,并用于优化聚合权重而不需额外数据或泄露隐私。通过赋予与全局优化方向更一致的本地模型更高权重,FedAWA提升了全局模型的稳定性和泛化能力。大量实验表明,在多种异构场景下,该方法表现优异,为解决联邦学习中的数据异构性问题提供了有效方案。
原文摘要 · Abstract (English)
Federated Learning (FL) has emerged as a promising framework for distributed machine learning, enabling collaborative model training without sharing local data, thereby preserving privacy and enhancing security. However, data heterogeneity resulting from differences across user behaviors, preferences, and device characteristics poses a significant challenge for federated learning. Most previous works overlook the adjustment of aggregation weights, relying solely on dataset size for weight assignment, which often leads to unstable convergence and reduced model performance. Recently, several studies have sought to refine aggregation strategies by incorporating dataset characteristics and model alignment. However, adaptively adjusting aggregation weights while ensuring data security-without requiring additional proxy data-remains a significant challenge. In this work, we propose Federated learning with Adaptive Weight Aggregation (FedAWA), a novel method that adaptively adjusts aggregation weights based on client vectors during the learning process. The client vector captures the direction of model updates, reflecting local data variations, and is used to optimize the aggregation weight without requiring additional datasets or violating privacy. By assigning higher aggregation weights to local models whose updates align closely with the global optimization direction, FedAWA enhances the stability and generalization of the global model. Extensive experiments under diverse scenarios demonstrate the superiority of our method, providing a promising solution to the challenges of data heterogeneity in federated learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。