arXiv:2411.15716cs.LGcs.CR2024-11被引 10

用合成数据缓解联邦时序预测中的数据异构问题

Tackling Data Heterogeneity in Federated Time Series Forecasting

  • 生成两类合成数据增强本地训练与全局模型
  • 在8个数据集上提升多种时序模型预测性能
  • 适合隐私敏感场景下的分布式时序预测任务

时序预测在能源消耗、疾病传播和天气预报等场景中至关重要。现有方法多依赖集中式训练,需将大量设备数据上传至云端,导致通信压力大且隐私风险高。联邦学习虽可保护隐私,但直接应用于时序预测效果不佳,因不同设备产生的时序数据具有内在异构性。本文提出新框架 Fed-TREND,通过生成两类合成数据缓解该问题:第一类基于客户端上传的模型更新,捕捉代表性分布信息,增强本地训练一致性;第二类从全局模型更新轨迹中提取长期影响规律,用于聚合后优化全局模型。该框架兼容主流时序预测模型,可无缝集成至现有联邦学习系统。在8个数据集上,使用多个联邦基线和4种主流时序模型的实验表明,Fed-TREND有效提升了预测性能,具备良好通用性。

原文摘要 · Abstract (English)

Time series forecasting plays a critical role in various real-world applications, including energy consumption prediction, disease transmission monitoring, and weather forecasting. Although substantial progress has been made in time series forecasting, most existing methods rely on a centralized training paradigm, where large amounts of data are collected from distributed devices (e.g., sensors, wearables) to a central cloud server. However, this paradigm has overloaded communication networks and raised privacy concerns. Federated learning, a popular privacy-preserving technique, enables collaborative model training across distributed data sources. However, directly applying federated learning to time series forecasting often yields suboptimal results, as time series data generated by different devices are inherently heterogeneous. In this paper, we propose a novel framework, Fed-TREND, to address data heterogeneity by generating informative synthetic data as auxiliary knowledge carriers. Specifically, Fed-TREND generates two types of synthetic data. The first type of synthetic data captures the representative distribution information from clients' uploaded model updates and enhances clients' local training consensus. The second kind of synthetic data extracts long-term influence insights from global model update trajectories and is used to refine the global model after aggregation. Fed-TREND is compatible with most time series forecasting models and can be seamlessly integrated into existing federated learning frameworks to improve prediction performance. Extensive experiments on eight datasets, using several federated learning baselines and four popular time series forecasting models, demonstrate the effectiveness and generalizability of Fed-TREND.

联邦学习时序预测数据异构合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。