arXiv:2507.20871cs.NIcs.LG2025-07中稿 · ICC 2025被引 2

通过注意力机制动态选客户端,提升联邦学习效率与精度

FedABC: Attention-Based Client Selection for Federated Learning with Long-Term View

  • 用注意力机制评估客户端贡献和模型相似性,智能选人
  • 训练后期放宽标准,让更多客户端参与,准确率提高3.5%
  • 适合资源有限、数据异构的6G场景,降低通信开销

6G网络中本地AI支持是关键目标,联邦学习(FL)为此提供了有前景的范式。在不直接共享数据的前提下,客户端在本地训练模型并上传更新,由服务器聚合以优化全局模型。然而,数据异构性导致收敛慢、准确率低,频繁参与又带来通信与计算负担。为此,本文提出FedABC,一种具有长期视角的客户端选择算法。受注意力机制启发,该算法同时考量模型相似性与各客户端对全局模型的独特贡献。针对全局模型需求随时间变化的特点,构建优化问题指导整个训练过程。遵循“后期更优”原则,自适应调整客户端选择阈值,鼓励后期增加参与。在CIFAR-10上的大量仿真表明,相比传统方法,FedABC显著提升性能:达到与经典算法FedAvg相当的精度仅需减少32%的客户端;相较当前最优方法,在减少2%客户端的情况下准确率高出3.5%。本工作推动了联邦学习在异构、资源受限环境中的部署,助力6G原生AI能力实现。

原文摘要 · Abstract (English)

Native AI support is a key objective in the evolution of 6G networks, with Federated Learning (FL) emerging as a promising paradigm. FL allows decentralized clients to collaboratively train an AI model without directly sharing their data, preserving privacy. Clients train local models on private data and share model updates, which a central server aggregates to refine the global model and redistribute it for the next iteration. However, client data heterogeneity slows convergence and reduces model accuracy, and frequent client participation imposes communication and computational burdens. To address these challenges, we propose FedABC, an innovative client selection algorithm designed to take a long-term view in managing data heterogeneity and optimizing client participation. Inspired by attention mechanisms, FedABC prioritizes informative clients by evaluating both model similarity and each model's unique contributions to the global model. Moreover, considering the evolving demands of the global model, we formulate an optimization problem to guide FedABC throughout the training process. Following the "later-is-better" principle, FedABC adaptively adjusts the client selection threshold, encouraging greater participation in later training stages. Extensive simulations on CIFAR-10 demonstrate that FedABC significantly outperforms existing approaches in model accuracy and client participation efficiency, achieving comparable performance with 32% fewer clients than the classical FL algorithm FedAvg, and 3.5% higher accuracy with 2% fewer clients than the state-of-the-art. This work marks a step toward deploying FL in heterogeneous, resource-constrained environments, thereby supporting native AI capabilities in 6G networks.

联邦学习客户端选择6G网络注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。