让大模型主动探查时间序列,更懂任务意图
InA-Probe: Instruction-Aware Active Probing for Time Series Forecasting with LLMs

- 通过动态生成查询,让大模型主动探测时序数据
- 跨领域场景下预测误差降低最高达37%
- 适合需要理解复杂任务指令的时序预测场景
大语言模型在时间序列预测中展现出巨大潜力。然而,现有方法多依赖被动模态对齐或静态任务重编程,难以捕捉细粒度、非平稳的时序模式,也无法适应细微的任务意图。本文提出指令感知主动探查(InA-Probe),将范式从被动对齐转向主动、指令驱动的探查机制。设计多层次指令注入机制,为模型注入全局任务目标和细粒度的片段级语义先验;构建自适应查询生成模块,根据时序上下文动态生成样本特定的探查信号。这些探查信号通过双阶段注意力过程优化:首先通过指令感知自注意力内化任务意图,再通过时序交叉注意力深入探测投影后的时序表征,提取关键模式。在七个真实世界基准上的实验表明,InA-Probe持续优于最先进深度学习与基于LLM的基线方法,在一概而论的泛化能力与零样本迁移上表现优异,尤其在挑战性的跨域场景中预测误差最高降低37%。消融实验进一步证实,自适应查询与细粒度指令间的协同作用是释放大模型推理能力的关键。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have recently demonstrated impressive potential for time series forecasting. However, existing methods predominantly rely on passive modality alignment or static task reprogramming, which often fail to capture fine-grained, non-stationary temporal patterns or to adapt to nuanced task intents. In this paper, we propose Instruction-aware Active Probing (InA-Probe), which shifts the paradigm from passive alignment toward an active, instruction-driven probing mechanism. Specifically, we design a Multi-Level Instruction Injection mechanism that enriches the model with both global task objectives and fine-grained, patch-level semantic priors. Building on this, an Adaptive Query Generation module produces sample-specific probes that are dynamically modulated by the temporal context. These probes are then refined through a dual-stage attention process: they first internalize task-specific intents via Instruction-Aware Self-Attention, and subsequently interrogate the projected temporal representations through Temporal Cross-Attention to extract salient patterns. Comprehensive experiments on seven real-world benchmarks show that InA-Probe consistently outperforms state-of-the-art deep learning and LLM-based baselines, excelling in both one-for-all generalization and zero-shot transfer while reducing forecasting error by up to 37\% in challenging cross-domain scenarios. Ablation studies further confirm that the synergy between adaptive querying and fine-grained instructions is key to unlocking the reasoning power of LLMs for complex time series.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。