FedACT 能高效调度异构设备,同时运行多个联邦学习任务。
FedACT: Concurrent Federated Intelligence across Heterogeneous Data Sources

- 根据设备资源与任务需求的匹配度动态分配设备
- 平均任务完成时间降低8.3倍,模型准确率提升44.5%
- 兼顾公平性,适合多任务并行的现实联邦学习场景
联邦学习(FL)可在保护隐私的前提下,实现分布式数据源设备间的协同智能。尽管现有研究多聚焦于单个任务的优化,但实际应用中越来越多需要在共享设备池上同时训练多个机器学习任务。直接套用单任务联邦学习优化方法会导致系统性能下降,尤其受设备异构性和资源低效使用影响。为此,我们提出 FedACT,一种面向资源异构性的设备调度方法,旨在最小化多个并发联邦学习任务的平均任务完成时间(JCT)。FedACT 通过动态分配设备,基于对设备可用资源与任务资源需求的匹配度评分进行决策,并引入参与公平性机制,确保各任务间设备贡献均衡,从而提升全局模型精度。调度方案优先选择匹配度高的设备,同时保障任务间公平性。我们在多种联邦学习任务和基准数据集上进行了全面实验,结果表明,相比最先进基线,FedACT 最多可将平均任务完成时间降低 8.3 倍,模型准确率提升最高达 44.5%。
原文摘要 · Abstract (English)
Federated Learning (FL) enables collaborative intelligence across decentralized data source devices in a privacy-preserving way. While substantial research attention has been drawn to optimizing the learning process for an individual task, real-world applications increasingly require multiple machine learning tasks simultaneously training their models across a shared pool of devices. Naively applying single-FL optimization techniques in multi-FL systems results in suboptimal system performance, particularly due to device heterogeneity and resource inefficiency. To address such a critical open challenge, we introduce {\em FedACT}, a novel resource heterogeneity-aware device scheduling approach designed to efficiently schedule heterogeneous devices across multiple concurrent FL jobs, with the goal of minimizing their average job completion time (JCT). {\em FedACT} dynamically assigns devices to FL jobs based on an alignment scoring mechanism that evaluates the compatibility between available resources of devices and resource demands of jobs. Additionally, it incorporates participation fairness to ensure balanced contributions from devices across jobs, further enhancing the accuracy levels of learned global models. An optimal scheduling plan is formulated in {\em FedACT} by prioritizing devices with higher alignment scores, while ensuring fair participation across jobs. To evaluate the effectiveness of the proposed scheduling algorithm, we carried out comprehensive experiments using diverse FL jobs and benchmark datasets. Experimental results demonstrate that {\em FedACT} reduces the average JCT by up to 8.3\(\times\) and improves model accuracy by up to 44.5\%, compared to the state-of-the-art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。