用双记忆架构提升时间序列分类精度,兼顾长短期依赖。
KairosHope: A Next-Generation Time-Series Foundation Model for Specialized Classification via Dual-Memory Architecture

- 用动态短时记忆+长期上下文记忆替代传统注意力
- 在UCR数据集上优于主流模型,尤其在因果性强的场景
- 适合需要高精度时序分类的工业或医疗场景
时间序列基础模型(TSFM)在通用预测任务中表现优异,但在专业化分类任务中受限于标准注意力的计算瓶颈和对经典统计知识的忽视。本文提出KairosHope,一种下一代TSFM,通过HOPE模块实现大规模泛化与分析精度的统一。该模块以双记忆系统替代二次注意力:Titans模块负责动态短时记忆,连续记忆系统(CMS)用于抽象长期历史上下文。为增强归纳偏置,引入混合决策头,融合深层潜在表示与tsfeatures工具包提取的确定性统计特征。KairosHope在大型Monash数据集上进行自监督预训练,采用掩码时间序列建模(MTSM)与对比学习(InfoNCE)。后续在UCR基准数据集上通过线性探测与全微调(LP-FT)协议适应,防止灾难性遗忘。实验证明其在具有强时间因果性的领域(如人体活动识别或传感器数据)表现卓越,建立了一套高效可靠的时序分析基础模型适配框架。
原文摘要 · Abstract (English)
Time Series Foundation Models (TSFMs) have demonstrated notable success in general-purpose forecasting tasks; however, their adaptation to specialized classification problems remains constrained by the computational bottleneck of standard attention and the systematic omission of classical statistical knowledge. This technical report introduces KairosHope, a next-generation TSFM designed to reconcile massive generalization with analytical precision in classification tasks. The core of the proposal is the HOPE block, an architecture that replaces quadratic attention with a dual-memory system: Titans modules for dynamic short-term retention and a Continuum Memory System (CMS) for the abstraction of long-term historical context. To enrich the inductive bias, a Hybrid Decision Head is introduced, which fuses deep latent representations with deterministic statistical features extracted via tsfeatures package. KairosHope undergoes self-supervised pre-training on the massive Monash archive, combining Masked Time Series Modeling (MTSM) and contrastive learning (InfoNCE). Its subsequent adaptation to the UCR benchmark datasets is conducted through a rigorous Linear Probing and Full Fine-Tuning (LP-FT) protocol to prevent catastrophic forgetting. Empirical results demonstrate superior performance in domains characterized by strict temporal causality such as HAR or Sensor data. Consequently, KairosHope establishes a robust and efficient framework for the adaptation of foundation models to time series analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。