用语言模型生成标签,让时间序列分类更懂语义。
InstructTime++: Time Series Classification with Multimodal Language Modeling via Implicit Feature Enhancement
- 将时序数据转为文本令牌,用语言模型生成类别标签。
- 在多个基准数据集上准确率超越现有方法,最高提升3.2%。
- 适合需要理解类间语义关系的工业时序分析场景。
现有时间序列分类方法多采用判别式范式,直接将输入序列映射到独热编码标签,虽有效但难以融入上下文特征,也未能捕捉类别间的语义关联。为此,我们提出InstructTime,将时间序列分类重构为多模态生成任务:将连续数值序列、上下文文本特征和任务指令作为多模态输入,由微调的语言模型生成文本化标签。为弥合模态差距,InstructTime引入时序离散化模块,将连续序列转换为离散时间令牌,并结合对齐投影层与生成式自监督预训练策略,增强跨模态表征对齐。在此基础上,我们进一步提出InstructTime++,通过隐式特征建模弥补语言模型的归纳偏置不足。InstructTime++利用专用工具包从原始时序与上下文输入中挖掘信息性隐含模式,包括统计特征提取与基于视觉-语言的图像描述生成,并将其转化为文本描述实现无缝集成。在多个基准数据集上的大量实验表明,InstructTime++表现优异,显著优于基线方法。
原文摘要 · Abstract (English)
Most existing time series classification methods adopt a discriminative paradigm that maps input sequences directly to one-hot encoded class labels. While effective, this paradigm struggles to incorporate contextual features and fails to capture semantic relationships among classes. To address these limitations, we propose InstructTime, a novel framework that reformulates time series classification as a multimodal generative task. Specifically, continuous numerical sequences, contextual textual features, and task instructions are treated as multimodal inputs, while class labels are generated as textual outputs by tuned language models. To bridge the modality gap, InstructTime introduces a time series discretization module that converts continuous sequences into discrete temporal tokens, together with an alignment projection layer and a generative self-supervised pre-training strategy to enhance cross-modal representation alignment. Building upon this framework, we further propose InstructTime++, which extends InstructTime by incorporating implicit feature modeling to compensate for the limited inductive bias of language models. InstructTime++ leverages specialized toolkits to mine informative implicit patterns from raw time series and contextual inputs, including statistical feature extraction and vision-language-based image captioning, and translates them into textual descriptions for seamless integration. Extensive experiments on multiple benchmark datasets demonstrate the superior performance of InstructTime++.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。