arXiv:2505.03533cs.LG2025-05被引 3

针对无线联邦学习中快速信道变化问题,提出自适应资源分配方案。

Small-Scale-Fading-Aware Resource Allocation in Wireless Federated Learning

  • 基于多智能体强化学习,动态分配频谱与功率
  • 在多种统计异构性下,训练收敛速度提升显著
  • 适合高动态信道环境下的分布式学习系统

合理的资源分配可有效提升无线网络中联邦学习(FL)的训练性能,应对系统与统计异构性。然而,现有策略通常依赖块衰落假设,忽视了每轮梯度上传期间的快速信道波动,导致训练性能下降。本文提出一种小尺度衰落感知的资源分配策略,采用多智能体强化学习(MARL)框架。具体地,我们建立了FL算法的一步收敛界,并将资源分配问题建模为分散式部分可观测马尔可夫决策过程(Dec-POMDP),通过QMIX算法求解。在该框架中,每个客户端作为智能体,在每个相干时隙内根据本地观测和来自收敛分析的奖励,动态决定频谱与功率分配。MARL设置降低了动作空间维度,支持分布式决策,提升了方案的可扩展性与实用性。实验结果表明,基于QMIX的资源分配策略在不同统计异构性条件下均显著优于基线方法。消融实验验证了引入小尺度衰落动态的关键作用,凸显其对优化联邦学习性能的重要性。

原文摘要 · Abstract (English)

Judicious resource allocation can effectively enhance federated learning (FL) training performance in wireless networks by addressing both system and statistical heterogeneity. However, existing strategies typically rely on block fading assumptions, which overlooks rapid channel fluctuations within each round of FL gradient uploading, leading to a degradation in FL training performance. Therefore, this paper proposes a small-scale-fading-aware resource allocation strategy using a multi-agent reinforcement learning (MARL) framework. Specifically, we establish a one-step convergence bound of the FL algorithm and formulate the resource allocation problem as a decentralized partially observable Markov decision process (Dec-POMDP), which is subsequently solved using the QMIX algorithm. In our framework, each client serves as an agent that dynamically determines spectrum and power allocations within each coherence time slot, based on local observations and a reward derived from the convergence analysis. The MARL setting reduces the dimensionality of the action space and facilitates decentralized decision-making, enhancing the scalability and practicality of the solution. Experimental results demonstrate that our QMIX-based resource allocation strategy significantly outperforms baseline methods across various degrees of statistical heterogeneity. Additionally, ablation studies validate the critical importance of incorporating small-scale fading dynamics, highlighting its role in optimizing FL performance.

联邦学习资源分配强化学习无线通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。