针对异构环境下的联邦学习,通过聚类分组优化更新策略,提升模型精度与效率。
Cluster-Aware Multi-Round Update for Wireless Federated Learning in Heterogeneous Environments
- 按数据与通信特性聚类设备,以集群为单位进行更新
- 动态调整本地更新频率,降低更新偏差,提升聚合准确率
- 兼顾计算与通信资源,在有限条件下实现高效收敛
无线联邦学习(FL)的聚合效率和精度在异构环境中受资源限制严重影响,设备间存在差异化的数据分布和通信能力。本文提出一种基于先验知识相似性的聚类策略,将数据与通信特征相近的设备分组,缓解异构性带来的性能下降。在此基础上,设计了一种新的簇感知多轮更新(CAMU)策略,以簇为基本单位,根据簇贡献阈值动态调整本地更新频率,有效减少更新偏差并提升聚合精度。理论分析严格证明了CAMU的收敛性;同时,基于收敛上界,联合优化各簇的本地更新频率与传输功率,在资源受限条件下实现计算与通信资源的最佳平衡,显著提升联邦学习的收敛效率。实验结果表明,该方法在异构环境下有效改善了模型性能,并在通信开销与计算负载之间取得更优平衡。
原文摘要 · Abstract (English)
The aggregation efficiency and accuracy of wireless Federated Learning (FL) are significantly affected by resource constraints, especially in heterogeneous environments where devices exhibit distinct data distributions and communication capabilities. This paper proposes a clustering strategy that leverages prior knowledge similarity to group devices with similar data and communication characteristics, mitigating performance degradation from heterogeneity. On this basis, a novel Cluster- Aware Multi-round Update (CAMU) strategy is proposed, which treats clusters as the basic units and adjusts the local update frequency based on the clustered contribution threshold, effectively reducing update bias and enhancing aggregation accuracy. The theoretical convergence of the CAMU strategy is rigorously validated. Meanwhile, based on the convergence upper bound, the local update frequency and transmission power of each cluster are jointly optimized to achieve an optimal balance between computation and communication resources under constrained conditions, significantly improving the convergence efficiency of FL. Experimental results demonstrate that the proposed method effectively improves the model performance of FL in heterogeneous environments and achieves a better balance between communication cost and computational load under limited resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。