针对建筑能耗预测,提出个性化联邦稀疏适配框架,提升模型性能与泛化能力。
Personalized Federated Sparse Adaptation of Time-Series Foundation Models

- 采用异构时间混合专家架构,按168小时窗口动态选择专家
- 在50栋建筑上,个性化联邦方法优于全局与本地训练,性能提升显著
- 适配策略需根据模型骨架和评估指标调整,适合分布式时序建模场景
联邦适配时间序列基础模型(TSFMs)在建筑能耗预测中具有吸引力,因电表数据私密、分散且高度非独立同分布。然而单一参数共享策略难以满足所有预训练模型或建筑客户端:完全共享适配器会抑制建筑特异性时序行为,而完全本地适配则丢失跨建筑迁移收益。本文提出一种个性化联邦稀疏适配框架,在预训练TSFM表示后引入异构时间混合专家(MoE)适配器。序列级路由模块将每个168小时上下文窗口映射至顶-k个专家子集,分别专精周期性、长程交互、局部变化、趋势-残差结构及多分辨率行为。在50栋建筑与三种TSFM骨干网络上对比全局联邦学习、本地训练及个性化联邦变体(使用全局共享或客户端私有专家库),结果表明个性化方法始终优于全局与本地基线;最优稀疏适配策略随骨干网络与评价指标变化。路由行为进一步揭示客户端级专家专业化、专家集中度及各骨干间近似均匀路由特性,表明联邦TSFM适配应兼具客户端感知与骨干感知特性。
原文摘要 · Abstract (English)
Federated adaptation of time-series foundation models (TSFMs) is attractive for building energy forecasting because meter data are private, distributed, and highly non-IID. However, a single parameter-sharing strategy is unlikely to serve all pretrained TSFMs or building clients: fully shared adapters can suppress building-specific temporal behavior, while fully local adaptation discards cross-building transfer. We propose a personalized federated sparse adaptation framework with a heterogeneous temporal mixture-of-experts (MoE) adapter placed after the pretrained TSFM representation. A sequence-level router maps each 168-hour context window to a top-$k$ subset of experts specialized for periodicity, long-range interactions, local variation, trend-residual structure, and multi-resolution behavior. We compare global FL, local training, and personalized FL variants with globally shared or client-private expert banks. Across 50 buildings and three TSFM backbones, personalization consistently outperforms Global FL-MoE and Local MoE, while the best sparse-adaptation strategy varies by backbone and metric. Routing behavior further reveals client-level expert specialization, expert concentration, and near-uniform routing across backbones, showing that federated TSFM adaptation should be both client-aware and backbone-aware.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。