针对物联网时间序列数据,提出去趋势化方法提升联邦学习预测精度。
D3FL: Data Distribution and Detrending for Robust Federated Learning in Non-linear Time-series Data
- 设计去趋势化流程处理非线性、非平稳时间序列分布。
- 实验证明去趋势后联邦学习损失显著降低,性能逼近集中式训练。
- 适用于智能能源、环境监测等分布式时序预测场景。
随着计算与通信技术发展,物联网设备广泛部署于温湿度、电表等传感器采集数据,其本质为时序数据。传统集中式分析存在延迟高、通信成本大的问题,联邦学习(FL)成为替代方案。然而,不同地理位置的设备数据常呈现显著的趋势与季节性差异,导致非平稳、非线性时间序列建模困难,影响预测准确性。本文研究了广义极值(gen-extreme)和对数正态(log norm)等非线性分布对联邦学习性能的影响,并评估了多种去趋势方法在联邦框架下的效果。通过生成合成数据集并使用LSTM模型对比中心化与联邦训练,结合真实世界非线性时序数据验证,结果表明:(1)在非线性分布下,联邦学习性能劣于集中式训练;(2)采用合适去趋势技术可有效提升联邦学习表现,降低多类分布下的损失值。
原文摘要 · Abstract (English)
With advancements in computing and communication technologies, the Internet of Things (IoT) has seen significant growth. IoT devices typically collect data from various sensors, such as temperature, humidity, and energy meters. Much of this data is temporal in nature. Traditionally, data from IoT devices is centralized for analysis, but this approach introduces delays and increased communication costs. Federated learning (FL) has emerged as an effective alternative, allowing for model training across distributed devices without the need to centralize data. In many applications, such as smart home energy and environmental monitoring, the data collected by IoT devices across different locations can exhibit significant variation in trends and seasonal patterns. Accurately forecasting such non-stationary, non-linear time-series data is crucial for applications like energy consumption estimation and weather forecasting. However, these data variations can severely impact prediction accuracy. The key contributions of this paper are: (1) Investigating how non-linear, non-stationary time-series data distributions, like generalized extreme value (gen-extreme) and log norm distributions, affect FL performance. (2) Analyzing how different detrending techniques for non-linear time-series data influence the forecasting model's performance in a FL setup. We generated several synthetic time-series datasets using non-linear data distributions and trained an LSTM-based forecasting model using both centralized and FL approaches. Additionally, we evaluated the impact of detrending on real-world datasets with non-linear time-series data distributions. Our experimental results show that: (1) FL performs worse than centralized approaches when dealing with non-linear data distributions. (2) The use of appropriate detrending techniques improves FL performance, reducing loss across different data distributions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。