针对动态数据的联邦边缘学习,提出实时感知漂移与差异的调度算法。
FedTeddi: Temporal Drift and Divergence Aware Scheduling for Timely Federated Edge Learning
- 通过时序漂移和集体发散度量数据变化,用EMD量化类别分布差异
- 联合优化调度与带宽分配,在资源受限下实现更快收敛,提速58.4%~49.2%
- 适合长期运行、数据持续更新的边缘智能场景
联邦边缘学习(FEEL)可在不暴露原始数据的前提下,通过无线网络在分布式客户端间协同训练模型。现有研究多假设数据集静态,但现实场景中客户端持续收集具有时变性与非独立同分布(non-i.i.d.)特性的数据。核心挑战在于如何在动态数据演化与通信资源限制下,及时高效地更新模型。本文提出FedTeddi,一种感知时序漂移与数据发散的调度算法,以加速动态数据下的FEEL收敛。首先,利用时序漂移和集体发散分别量化数据的时间动态性与非i.i.d.特性,以分类任务中类别分布的地球移动距离(EMD)表示。随后,设计新型优化目标,并开发联合调度与带宽分配算法,使系统在快速学习新数据的同时保留旧知识。实验表明,该算法在CIFAR-10上相比随机调度提升收敛速度58.4%,在CIFAR-100上提升49.2%,测试准确率更高,表现优于基准方法。
原文摘要 · Abstract (English)
Federated edge learning (FEEL) enables collaborative model training across distributed clients over wireless networks without exposing raw data. While most existing studies assume static datasets, in real-world scenarios clients may continuously collect data with time-varying and non-independent and identically distributed (non-i.i.d.) characteristics. A critical challenge is how to adapt models in a timely yet efficient manner to such evolving data. In this paper, we propose FedTeddi, a temporal-drift-and-divergence-aware scheduling algorithm that facilitates fast convergence of FEEL under dynamic data evolution and communication resource limits. We first quantify the temporal dynamics and non-i.i.d. characteristics of data using temporal drift and collective divergence, respectively, and represent them as the Earth Mover's Distance (EMD) of class distributions for classification tasks. We then propose a novel optimization objective and develop a joint scheduling and bandwidth allocation algorithm, enabling the FEEL system to learn from new data quickly without forgetting previous knowledge. Experimental results show that our algorithm achieves higher test accuracy and faster convergence compared to benchmark methods, improving the rate of convergence by 58.4% on CIFAR-10 and 49.2% on CIFAR-100 compared to random scheduling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。