针对联邦学习中客户端动态变化问题,提出可信调度机制提升训练效率。
TRAIL: Trust-Aware Client Scheduling for Semi-Decentralized Federated Learning
- 基于自适应隐马尔可夫模型评估客户端通信状态与贡献度。
- 实验显示测试准确率提升8.7%,训练损失降低15.3%。
- 适合边缘计算中不稳定的分布式训练场景使用。
由于数据敏感性,联邦学习(FL)被用于实现分布式机器学习,同时保护数据隐私并满足不同设备需求。然而,在半去中心化联邦学习中,客户端的通信与训练状态具有动态性,这源于本地训练波动、数据分布异构以及客户端间歇性参与。现有研究多关注稳定状态,忽视了真实场景中的动态挑战。为此,本文提出一种信任感知的客户端调度机制TRAIL,通过评估客户端状态与贡献,提升模型训练效率。在半去中心化框架下,边缘服务器与客户端使用不可靠的集群内聚合和跨集群共识训练共享全局模型。首先,提出自适应隐半马尔可夫模型以估计客户端通信状态与贡献;其次,构建客户端-服务器关联优化问题以最小化全局训练损失;基于收敛性分析,设计贪心调度算法。在真实数据集上的实验表明,TRAIL优于现有基线方法,测试准确率提升8.7%,训练损失降低15.3%。
原文摘要 · Abstract (English)
Due to the sensitivity of data, Federated Learning (FL) is employed to enable distributed machine learning while safeguarding data privacy and accommodating the requirements of various devices. However, in the context of semi-decentralized FL, clients' communication and training states are dynamic. This variability arises from local training fluctuations, heterogeneous data distributions, and intermittent client participation. Most existing studies primarily focus on stable client states, neglecting the dynamic challenges inherent in real-world scenarios. To tackle this issue, we propose a TRust-Aware clIent scheduLing mechanism called TRAIL, which assesses client states and contributions, enhancing model training efficiency through selective client participation. We focus on a semi-decentralized FL framework where edge servers and clients train a shared global model using unreliable intra-cluster model aggregation and inter-cluster model consensus. First, we propose an adaptive hidden semi-Markov model to estimate clients' communication states and contributions. Next, we address a client-server association optimization problem to minimize global training loss. Using convergence analysis, we propose a greedy client scheduling algorithm. Finally, our experiments conducted on real-world datasets demonstrate that TRAIL outperforms state-of-the-art baselines, achieving an improvement of 8.7% in test accuracy and a reduction of 15.3% in training loss.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。