用图像模型隐含表示做时间序列分类,效果超越现有方法。
Time Series Representations for Classification Lie Hidden in Pretrained Vision Transformers
- 将时间序列转为图像,复用预训练视觉模型的特征提取能力。
- 在标准数据集上达到最新性能,中间层高内在维度表征最有效。
- 适合想快速提升时序分类效果的研究者和工业应用开发者。
时间序列分类是医疗和工业领域的基础任务,但受限于公开时间序列数据集稀缺,时间序列基础模型(TSFMs)发展缓慢。本文提出时间视觉变换器(TiViT),将时间序列转换为图像,以利用在大规模图像数据集上预训练的冻结视觉变换器(ViTs)的表征能力。理论上,分析了ViTs的二维分块机制对时间序列的作用,表明其可增加与标签相关的信息片段并降低样本复杂度。实验上,TiViT通过使用大型OpenCLIP模型的隐含表示,在标准时间序列分类基准上实现领先性能。研究发现,具有高内在维度的中间层表示最适用于时间序列分类。进一步评估发现,TiViT与时间序列基础模型的表示空间存在强互补性,融合两者特征可带来额外性能提升。结果揭示了在非视觉领域重用视觉表示的新方向。代码已开源:https://github.com/ExplainableML/TiViT。
原文摘要 · Abstract (English)
Time series classification is a fundamental task in healthcare and industry, yet the development of time series foundation models (TSFMs) remains limited by the scarcity of publicly available time series datasets. In this work, we propose Time Vision Transformer (TiViT), a framework that converts time series into images to leverage the representational power of frozen Vision Transformers (ViTs) pretrained on large-scale image datasets. First, we theoretically motivate our approach by analyzing the 2D patching of ViTs for time series, showing that it can increase the number of label-relevant tokens and reduce the sample complexity. Second, we empirically demonstrate that TiViT achieves state-of-the-art performance on standard time series classification benchmarks by utilizing the hidden representations of large OpenCLIP models. We explore the structure of TiViT representations and find that intermediate layers with high intrinsic dimension are the most effective for time series classification. Finally, we assess the alignment between TiViT and TSFM representation spaces and identify a strong complementarity, with further performance gains achieved by combining their features. Our findings reveal a new direction for reusing vision representations in a non-visual domain. Code is available at https://github.com/ExplainableML/TiViT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。