用分层结构对齐时序与语义,让大模型更懂时间数据
Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification
- 分层编码器提取时序特征,兼顾数据特性和任务需求
- 通过语义空间对齐减少数值与文本表示的差距
- 参数高效微调激活生成式分类能力,适合多模态时序场景
时序分类在众多实际应用中具有基础性作用。近年来,大语言模型(LLMs)展现出强大的泛化与推理能力,但直接将其应用于时序分类仍面临数值序列与语义表达之间的表征鸿沟。本文提出HiTime,一种基于分层结构的多模态时序分类框架,在生成范式下弥合时序结构表征与语义推理的差距。具体而言,设计由数据特定编码器和任务特定编码器组成的分层序列特征编码模块,以提取互补的时序特征;为缓解时序表示与文本语义间的嵌入差异,引入语义空间对齐模块,同时实现粗粒度全局建模与细粒度跨模态对应。在此基础上,采用参数高效的监督微调策略激活对齐后大模型的生成式分类能力,将传统判别式时序分类转化为生成式任务。在多个基准数据集上的大量实验表明,该框架持续优于现有最优基线。代码已公开于 https://github.com/Xiaoyu-Tao/HiTime。
原文摘要 · Abstract (English)
Time series classification plays a fundamental role in a wide range of real-world applications. Recently, large language models (LLMs) have demonstrated strong generalization and reasoning capacities, but directly applying them to time series classification remains non-trivial due to the representation gap between numerical sequences and linguistic semantics. In this paper, we propose HiTime, a hierarchical LLM-based framework for multimodal time series classification that bridges structured temporal representations with semantic reasoning in a generative paradigm. Specifically, we design a hierarchical sequence feature encoding module composed of a data-specific encoder and a task-specific encoder to extract complementary temporal features. To mitigate the embedding gap between time series representations and textual semantics, we further introduce a semantic space alignment module that jointly performs coarse-grained global modeling and fine-grained cross-modal correspondence. Building upon the above representations, we employ a parameter-efficient supervised fine-tuning strategy to activate the generative classification capability of the algined LLMs, thereby transforming conventional discriminative time series classification into a generative task. Extensive experiments on multiple benchmarks demonstrate that the proposed framework consistently outperforms state-of-the-art baselines. The code is publicly available at https://github.com/Xiaoyu-Tao/HiTime.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。