根据时间序列特点自动选最合适的模型和模态,提升推理效果与效率。
TSRouter: Dynamic Modality-Model Selection for Time Series Reasoning

- 构建异构图动态路由,融合任务、查询、模态与模型的上下文关系。
- 在4个任务上相对基线提升16%~46%,且零样本适配新模型与任务。
- 支持按性能-成本偏好优化,降低计算开销,适合实际部署场景。
时间序列推理对现实问题解决至关重要。尽管大语言模型(LLMs)和视觉语言模型(VLMs)均可处理时间序列数据,但二者能力互补:LLMs将时间序列视为文本序列,保留精确数值理解,但难以捕捉全局模式;而VLMs通过可视化高效捕捉全局模式,却可能丢失细微细节。此外,不同模型在特定任务上表现差异显著,且推理成本不一。因此,为每个查询动态选择最合适的模态与模型至关重要,但挑战在于需建模任务、查询、模态与模型间复杂的交互关系,这些关系蕴含丰富上下文信号。为此,我们提出TSRouter,一种基于图的动态路由框架。该框架构建包含任务、查询、模态与模型节点的异构图,以刻画查询特征、模态属性与模型能力间的交互。将路由问题形式化为候选评分任务,根据用户定义的性能-成本偏好,评估每对模态-模型组合并选出最优方案。在4个不同时间序列推理任务上的全面评估表明,TSRouter显著优于多种基线,相对提升达16%至46%。此外,其在未见模型与新任务上展现出稳健的零样本即插即用泛化能力,并通过成本感知优化在保持高性能的同时减少计算开销。代码已开源:https://github.com/tianyi-lab/TSRouter。
原文摘要 · Abstract (English)
Time series reasoning is essential for real-world problem-solving. While both Large Language Models (LLMs) and Vision-Language Models (VLMs) can reason about time-series data, their capabilities are complementary: LLMs process time series as text sequences and thus preserve exact numerical understanding, but struggle with global patterns, whereas VLMs efficiently capture these patterns by visualizing time series but may lose fine-grained details. Moreover, models vary significantly in task-specific expertise and inference costs. Dynamically selecting the most suitable modality and model for each query is therefore crucial, yet challenging because it requires modeling the complex interactions among tasks, queries, modalities, and models, which carry rich contextual signals. To this end, we introduce TSRouter, a graph-based dynamic routing framework. TSRouter constructs a heterogeneous graph of task, query, modality, and model nodes to contextualize the interactions among query characteristics, modality attributes, and model capabilities. TSRouter formulates routing as a candidate scoring problem, where each modality-model pair is evaluated based on user-defined performance-cost preferences to select the optimal candidate. Comprehensive evaluations on 4 distinct time series reasoning tasks reveal that TSRouter substantially outperforms diverse baselines with 16\% to 46\% relative improvements. Furthermore, TSRouter demonstrates robust zero-shot plug-and-play generalization to unseen models and novel tasks and preserves high performance while reducing computational overhead through cost-aware optimization. Our code is available at https://github.com/tianyi-lab/TSRouter.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。