让低电量设备也能高效参与联邦学习,提升模型准确率与稳定性。
Learn More by Using Less: Distributed Learning with Energy-Constrained Devices
- 动态调整设备本地数据使用比例,智能分配训练负荷。
- 在高数据异构和低电量场景下,准确率提升显著,设备掉线率降低。
- 适合边缘计算、物联网等资源受限的隐私保护应用场景。
联邦学习(FL)为去中心化、隐私保护的分布式模型训练提供了方案,但参与设备的能量容量差异(系统异构性)限制了实际应用。能量限制不仅降低模型准确率,还增加设备掉线率,影响收敛。本文提出LeanFed,一种面向能源约束设备的能量感知联邦学习框架,通过自适应调整各设备在训练中使用的本地数据比例,优化客户端选择与训练负载分配,在保证设备不耗尽电量的前提下最大化参与度。我们在CIFAR-10和CIFAR-100数据集上对LeanFed与传统FedAvg进行对比评估,模拟不同数据异构性和设备参与率。结果表明,尤其在高数据异构和电池容量有限的场景下,LeanFed能有效减少客户端掉线、延长设备可用时间,显著提升模型准确率与稳定性。该方法展示了能源高效、隐私保护的联邦学习在真实大规模应用中的潜力,为资源受限网络上的可持续普适人工智能奠定基础。
原文摘要 · Abstract (English)
Federated Learning (FL) has emerged as a solution for distributed model training across decentralized, privacy-preserving devices, but the different energy capacities of participating devices (system heterogeneity) constrain real-world implementations. These energy limitations not only reduce model accuracy but also increase dropout rates, impacting on convergence in practical FL deployments. In this work, we propose LeanFed, an energy-aware FL framework designed to optimize client selection and training workloads on battery-constrained devices. LeanFed leverages adaptive data usage by dynamically adjusting the fraction of local data each device utilizes during training, thereby maximizing device participation across communication rounds while ensuring they do not run out of battery during the process. We rigorously evaluate LeanFed against traditional FedAvg on CIFAR-10 and CIFAR-100 datasets, simulating various levels of data heterogeneity and device participation rates. Results show that LeanFed consistently enhances model accuracy and stability, particularly in settings with high data heterogeneity and limited battery life, by mitigating client dropout and extending device availability. This approach demonstrates the potential of energy-efficient, privacy-preserving FL in real-world, large-scale applications, setting a foundation for robust and sustainable pervasive AI on resource-constrained networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。