提出在联邦学习中用过预测信号近似降低通信开销的方法
Overpredictive Signal Analytics in Federated Learning: Algorithms and Analysis
- 客户端用凸优化计算过预测信号近似,减少传输数据量
- 理论分析了通信成本、采样率与近似误差的权衡关系
- 适用于能源需求规划等需高精度预测的场景
边缘信号处理支持客户端-服务器架构下的分布式学习与推理。传统机器学习中,物联网设备获取原始信号样本后,可通过第三方平台聚合这些分布数据,协助数据中心训练全局信号模型。尽管物联网潜力巨大,此类部署常面临敏感隐私数据和通信速率限制的挑战。因此需要一种学习方法:仅传输分布式样本的处理后近似值,而非原始信号。本文将这种使用信号近似值的去中心化学习方法称为分布式信号分析。在由联邦学习驱动的网络容量规划等应用中,过预测信号近似尤为有益。本文提出算法,在客户端利用高效凸优化框架计算过预测信号近似,并通过数学分析量化通信成本、采样率与信号近似误差之间的权衡。还在公开的住宅能耗数据集上验证了所提分布式算法的性能。
原文摘要 · Abstract (English)
Edge signal processing facilitates distributed learning and inference in the client-server model proposed in federated learning. In traditional machine learning, clients (IoT devices) that acquire raw signal samples can aid a data center (server) learn a global signal model by pooling these distributed samples at a third-party location. Despite the promising capabilities of IoTs, these distributed deployments often face the challenge of sensitive private data and communication rate constraints. This necessitates a learning approach that communicates a processed approximation of the distributed samples instead of the raw signals. Such a decentralized learning approach using signal approximations will be termed distributed signal analytics in this work. Overpredictive signal approximations may be desired for distributed signal analytics, especially in network demand (capacity) planning applications motivated by federated learning. In this work, we propose algorithms that compute an overpredictive signal approximation at the client devices using an efficient convex optimization framework. Tradeoffs between communication cost, sampling rate, and the signal approximation error are quantified using mathematical analysis. We also show the performance of the proposed distributed algorithms on a publicly available residential energy consumption dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。