将时间序列转为符号提示,用轻量模型高效预测。
From Numbers to Prompts: A Cognitive Symbolic Transition Mechanism for Lightweight Time-Series Forecasting
- 用符号抽象和提示工程连接数值数据与语言模型
- 相比基线模型,MAE降低69%,MSE降低90%
- 适合资源受限场景下的时序预测应用
大语言模型在时间序列预测中表现优异,但其高计算与内存开销限制了在轻量平台的部署。本文提出符号过渡机制(STM),通过基于人类认知结构的量化技术,将连续时间序列值转化为符号令牌,并利用符号的结构化变换捕捉时间动态,使语言模型聚焦关键数据部分,实现快速推理。STM作为通用机制,在保持基础语言模型完整性的同时,显著提升其效率,通过推断时间序列中的动态与结构模式。我们在多个时序数据集上评估了STM,搭配四种小规模语言模型(SLM)在有限计算环境下测试。所有模型中,STM相较默认基线模型,MAE降低最多69%,MSE降低最多90%。结果表明,STM可作为基于符号驱动的时序预测高效适配层。精度提升代价极低:最大GPU内存仅增加约0.06%,延迟开销增加0.64%。
原文摘要 · Abstract (English)
Large language models have achieved remarkable success in time series prediction tasks, but their substantial computational and memory requirements limit deployment on lightweight platforms. In this paper, we propose the Symbolic Transition Mechanism (STM) a novel framework that bridges numeric time series data and language models through symbolic abstraction and prompt engineering. STM transforms continuous time series values into symbol tokens with quantization techniques based on human cognitive structures, and captures temporal dynamics through structured transformations of symbols, enabling fast engineering based predictions in which language models focus on critical parts of time series data. STM is a general purpose mechanisms that ensure the integrity of backbone language models, but they significantly improve their efficiency by inferring the dynamic and structured patterns inherent in time series data. We evaluated STM on various time series datasets, paired with four small language models (SLM) with limited computational environments. For all models, STM achieves error reductions of up to 69% in MAE and 90% in MSE compared to the default backbone SLM without STM. These results demonstrate the potential of STM as an efficient, adaptable layer for symbol-driven time series prediction using foundation models. The accuracy improvements were made at negligible resource costs, with maximum GPU memory of the base model increasing by approximately 0.06% and latency overhead increasing by only 0.64%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。