arXiv:2511.08142cs.LGcs.DC2025-11被引 1

BIPPO提升物联网联邦学习能效,动态选客户端且不超预算。

BIPPO: Budget-Aware Independent PPO for Energy-Efficient Federated Learning Services

  • 基于预算感知的独立PPO算法,多智能体协同优化客户端选择。
  • 在非独立同分布数据下准确率更高,资源消耗仅占总预算极小部分。
  • 适合资源受限的物联网联邦学习场景,兼具稳定与可扩展性。

联邦学习(FL)是大规模物联网系统中一种有前景的机器学习方案,能实现负载分发并保障隐私。然而,传统FL未考虑基础设施效率,这对资源受限环境至关重要。现有基于强化学习(RL)的客户端选择方法虽有一定改进,但未充分考虑资源限制和设备波动问题,且训练过程缺乏实用性,忽视泛化能力与能效优化。为此,本文提出预算感知独立近端策略优化(BIPPO),一种面向能源高效的多智能体强化学习方案,显著提升性能。我们在两个图像分类任务上评估BIPPO,采用高度预算受限设置,客户端在非独立同分布(non-IID)数据上训练,这是标准FL的挑战场景。BIPPO的改进采样机制使平均准确率优于无RL方法、传统PPO和IPPO。同时,其资源消耗始终维持在极低水平,即使客户端数量增加也保持稳定。总体而言,BIPPO为物联网联邦学习提供了高性能、稳定、可扩展且可持续的客户端选择解决方案。

原文摘要 · Abstract (English)

Federated Learning (FL) is a promising machine learning solution in large-scale IoT systems, guaranteeing load distribution and privacy. However, FL does not natively consider infrastructure efficiency, a critical concern for systems operating in resource-constrained environments. Several Reinforcement Learning (RL) based solutions offer improved client selection for FL; however, they do not consider infrastructure challenges, such as resource limitations and device churn. Furthermore, the training of RL methods is often not designed for practical application, as these approaches frequently do not consider generalizability and are not optimized for energy efficiency. To fill this gap, we propose BIPPO (Budget-aware Independent Proximal Policy Optimization), which is an energy-efficient multi-agent RL solution that improves performance. We evaluate BIPPO on two image classification tasks run in a highly budget-constrained setting, with FL clients training on non-IID data, a challenging context for vanilla FL. The improved sampler of BIPPO enables it to increase the mean accuracy compared to non-RL mechanisms, traditional PPO, and IPPO. In addition, BIPPO only consumes a negligible proportion of the budget, which stays consistent even if the number of clients increases. Overall, BIPPO delivers a performant, stable, scalable, and sustainable solution for client selection in IoT-FL.

联邦学习强化学习能效优化物联网

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。