arXiv:2602.17868cs.LGcs.AI2026-02被引 9

用合成数据和测试时策略,让时间序列模型零样本分类更准

MantisV2: Closing the Zero-Shot Gap in Time Series Classification with Synthetic Data and Test-Time Strategies

  • 基于合成数据预训练,提升模型泛化能力
  • 新架构与测试时优化使零样本性能达新高
  • 适合做通用时间序列特征提取的研究者使用

构建时间序列分类的通用基础模型具有重要实际意义,可作为多种下游任务的统一特征提取器。尽管早期模型如Mantis已展现潜力,但冻结与微调编码器间仍存在显著性能差距。本文提出方法显著提升时间序列的零样本特征提取能力:首先,引入完全在合成时间序列上预训练的Mantis+;其次,通过控制消融实验优化架构,得到更轻量高效的MantisV2;第三,提出增强型测试时策略,利用中间层表示并优化输出标记聚合。此外,通过自集成和跨模型嵌入融合进一步提升性能。在UCR、UEA、HAR及EEG数据集上的大量实验表明,MantisV2与Mantis+持续优于现有时间序列基础模型,实现当前最优零样本表现。

原文摘要 · Abstract (English)

Developing foundation models for time series classification is of high practical relevance, as such models can serve as universal feature extractors for diverse downstream tasks. Although early models such as Mantis have shown the promise of this approach, a substantial performance gap remained between frozen and fine-tuned encoders. In this work, we introduce methods that significantly strengthen zero-shot feature extraction for time series. First, we introduce Mantis+, a variant of Mantis pre-trained entirely on synthetic time series. Second, through controlled ablation studies, we refine the architecture and obtain MantisV2, an improved and more lightweight encoder. Third, we propose an enhanced test-time methodology that leverages intermediate-layer representations and refines output-token aggregation. In addition, we show that performance can be further improved via self-ensembling and cross-model embedding fusion. Extensive experiments on UCR, UEA, Human Activity Recognition (HAR) benchmarks, and EEG datasets show that MantisV2 and Mantis+ consistently outperform prior time series foundation models, achieving state-of-the-art zero-shot performance.

时间序列零样本合成数据特征提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。