arXiv:2602.13783cs.LG2026-02KDD被引 2

让时间序列模型自动记住领域特征,无需检索即可高效适配新场景。

MEMTS: Internalizing Domain Knowledge via Parameterized Memory for Retrieval-Free Domain Adaptation of Time Series Foundation Models

  • 用可学习的隐变量将领域特有周期模式内化为紧凑知识
  • 推理时零延迟,比现有方法快10倍以上且不丢失通用时序规律
  • 适合需要实时处理的工业预测系统,尤其对冷启动场景友好

尽管时间序列基础模型(TSFMs)在通用预测任务中表现优异,但在存在时序分布偏移和领域特异性周期结构的真实垂直领域中性能显著下降。现有方案受限于两种范式:域自适应预训练(DAPT)虽能提升短期适配性,但常因灾难性遗忘破坏已学全局时序模式;检索增强生成(RAG)虽引入外部知识,却带来巨大检索开销,难以满足实时流处理的高效率要求。为此,我们提出记忆型时间序列模型(MEMTS),一种轻量级、即插即用的无检索域自适应方法。核心是知识保持模块(KPM),将领域特有时间动态(如周期性模式、趋势)内化为一组可学习的隐原型,使碎片化历史观测转化为连续参数化知识表示。该范式实现恒定时间推理与近零延迟,有效缓解对通用时序模式的遗忘,且无需修改冻结的TSFM主干网络。多数据集实验证明,MEMTS达到当前最优性能。

原文摘要 · Abstract (English)

While Time Series Foundation Models (TSFMs) have demonstrated exceptional performance in generalized forecasting, their performance often degrades significantly when deployed in real-world vertical domains characterized by temporal distribution shifts and domain-specific periodic structures. Current solutions are primarily constrained by two paradigms: Domain-Adaptive Pretraining (DAPT), which improves short-term domain fitting but frequently disrupts previously learned global temporal patterns due to catastrophic forgetting; and Retrieval-Augmented Generation (RAG), which incorporates external knowledge but introduces substantial retrieval overhead. This creates a severe scalability bottleneck that fails to meet the high-efficiency requirements of real-time stream processing. To break this impasse, we propose Memory for Time Series (MEMTS), a lightweight and plug-and-play method for retrieval-free domain adaptation in time series forecasting. The key component of MEMTS is a Knowledge Persistence Module (KPM), which internalizes domain-specific temporal dynamics, such as recurring seasonal patterns and trends into a compact set of learnable latent prototypes. In doing so, it transforms fragmented historical observations into continuous, parameterized knowledge representations. This paradigm shift enables MEMTS to achieve accurate domain adaptation with constant-time inference and near-zero latency, while effectively mitigating catastrophic forgetting of general temporal patterns, all without requiring any architectural modifications to the frozen TSFM backbone. Extensive experiments on multiple datasets demonstrate the SOTA performance of MEMTS.

时间序列域自适应记忆机制低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。