arXiv:2604.04475cs.LGcs.AI2026-04被引 1

用离散原型记忆提升联邦时序模型的泛化能力

Discrete Prototypical Memories for Federated Time Series Foundation Models

  • 引入离散原型记忆,捕捉时序数据的周期性模式
  • 跨域记忆对齐使不同领域数据共享统一离散表征
  • 适合需要保护隐私的多源时序分析场景

将大型语言模型(LLMs)用于基于联邦学习(FL)的时序基础模型,可在不泄露私有数据的前提下,将LLMs的泛化能力迁移至时序数据。然而,现有方法中时序数据与文本主导的隐空间存在语义错位,导致性能下降。同时,现有联邦学习的参数共享机制将异构时序数据映射到统一连续隐空间,违背了时序语义常表现为离散且重复模式的事实。为此,我们提出 extsc{FeDPM},一种基于离散原型记忆的联邦时序基础模型框架。具体地,为每个域内时序数据学习局部原型记忆先验;通过跨域记忆对齐构建统一离散隐空间;引入领域特定的记忆更新机制,平衡共享与个性化原型知识。大量实验验证了 extsc{FeDPM}的高效性与有效性。代码已公开于https://anonymous.4open.science/r/FedUnit-64D1。

原文摘要 · Abstract (English)

Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data. However, the semantic misalignment between time-series data and the text-centric latent space of existing LLMs often leads to degraded performance. Meanwhile, the parameter-sharing mechanism in existing FL methods model heterogeneous cross-domain time-series data into a unified continuous latent space, which contradicts the fact that time-series semantics frequently manifest as discrete and recurring regimes. To address these limitations, we propose \textsc{FeDPM}, a federated framework for time-series foundation models based on discrete prototypical memories. Specifically, we learn local prototypical memory priors for intra-domain time-series data. We then align cross-domain memories to promote a unified discrete latent space and introduce a domain-specific memory update mechanism to balance shared and personalized prototypical knowledge. Extensive experiments demonstrate the efficiency and effectiveness of \textsc{FeDPM}. The code is publicly available at https://anonymous.4open.science/r/FedUnit-64D1.

联邦学习时序建模原型记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。