解决边缘联邦学习中非独立同分布数据下的参与偏差问题。
FedCure: Mitigating Participation Bias in Semi-Asynchronous Federated Learning with Non-IID Data
- 构建联盟并动态调度,缓解客户端分组带来的参与不均。
- 准确率最高提升5.1倍,单轮延迟变异系数低至0.0223。
- 适合关注边缘计算与异构数据场景的系统优化研究者。
半异步联邦学习(SAFL)虽兼顾同步训练效率与异步更新灵活性,但天然存在参与偏差,且在非独立同分布(non-IID)数据下进一步恶化。更关键的是,分层云-边-客户端架构使参与行为从个体客户转移至客户组,加剧了该问题。现有研究多聚焦传统云端架构,忽视非IID数据对跨层级调度的影响。为此,我们提出FedCure,一种创新的半异步联邦学习框架,通过联盟构建与参与感知调度缓解非IID数据下的参与偏差。其核心包含三项规则:(1) 偏好规则,通过最大化集体收益与理论稳定划分优化联盟形成,降低非IID导致的性能下降;(2) 调度规则,结合虚拟队列与贝叶斯估计的联盟动态,平衡效率与平均速率稳定性;(3) 资源分配规则,基于联盟动态估算优化客户端CPU频率,在满足延迟要求下提升计算效率。在四个真实数据集上的全面实验表明,相比四种前沿基线,FedCure准确率最高提升5.1倍,单轮延迟变异系数最低达0.0223,长期保持各场景下的均衡性。
原文摘要 · Abstract (English)
While semi-asynchronous federated learning (SAFL) combines the efficiency of synchronous training with the flexibility of asynchronous updates, it inherently suffers from participation bias, which is further exacerbated by non-IID data distributions. More importantly, hierarchical architecture shifts participation from individual clients to client groups, thereby further intensifying this issue. Despite notable advancements in SAFL research, most existing works still focus on conventional cloud-end architectures while largely overlooking the critical impact of non-IID data on scheduling across the cloud-edge-client hierarchy. To tackle these challenges, we propose FedCure, an innovative semi-asynchronous Federated learning framework that leverages coalition construction and participation-aware scheduling to mitigate participation bias with non-IID data. Specifically, FedCure operates through three key rules: (1) a preference rule that optimizes coalition formation by maximizing collective benefits and establishing theoretically stable partitions to reduce non-IID-induced performance degradation; (2) a scheduling rule that integrates the virtual queue technique with Bayesian-estimated coalition dynamics, mitigating efficiency loss while ensuring mean rate stability; and (3) a resource allocation rule that enhances computational efficiency by optimizing client CPU frequencies based on estimated coalition dynamics while satisfying delay requirements. Comprehensive experiments on four real-world datasets demonstrate that FedCure improves accuracy by up to 5.1x compared with four state-of-the-art baselines, while significantly enhancing efficiency with the lowest coefficient of variation 0.0223 for per-round latency and maintaining long-term balance across diverse scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。