arXiv:2511.19694cs.LGcs.AI2025-11被引 3

用合成数据训练的时序分类模型,零微调即可适应新任务。

TiCT: A Synthetically Pre-Trained Foundation Model for Time Series Classification

  • 基于合成数据预训练,采用位编码与输出注意力机制支持任意类别数。
  • 在UCR数据集上性能媲美监督模型,仅靠上下文样例推理。
  • 适合缺乏标注数据、需快速适配新任务的时序分类场景。

时间序列数据的普遍性催生了通用基础模型的需求,但分类任务因标注数据成本高而难以实现。具备上下文学习能力的基础模型可仅用少量样本适应新任务,避免大规模重训练。然而,现有大规模时序模型多聚焦于预测,缺乏通用且无需微调的分类方案。为此,我们提出TiCT(Time-series in-Context Transformer),一种仅通过合成数据预训练的Transformer模型,用于上下文分类。主要贡献包括:1)创新架构,采用可扩展的位基标签编码与特殊输出注意力机制,支持任意类别数;2)合成预训练框架,结合Mixup式过程与数据增强,提升泛化性与抗噪能力。在UCR Archive上的广泛评估显示,TiCT性能媲美当前最优监督方法,且推理时仅使用上下文样例,不更新任何模型权重。

原文摘要 · Abstract (English)

The ubiquity of time series data creates a strong demand for general-purpose foundation models, yet developing them for classification remains a significant challenge, largely due to the high cost of labeled data. Foundation models capable of in-context learning (ICL) offer a powerful solution, adapting to new tasks with minimal examples and reducing the need for extensive retraining. However, prior work on large-scale time series models has predominantly focused on forecasting, leaving a critical gap for versatile, fine-tuning-free classification. To address this, we introduce TiCT (Time-series in-Context Transformer), a transformer-based model pre-trained exclusively on synthetic data to perform in-context classification. We make two primary technical contributions: 1) a novel architecture featuring a scalable bit-based label encoding and a special output attention mechanism to handle an arbitrary number of classes; and 2) a synthetic pre-training framework that combines a Mixup-inspired process with data augmentation to foster generalization and noise invariance. Extensive evaluations on the UCR Archive show that TiCT achieves competitive performance against state-of-the-art supervised methods. Crucially, this is accomplished using only in-context examples at inference time, without updating a single model weight.

时序分类基础模型上下文学习合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。