用可学习提示统一建模城市交通多任务,提升跨场景泛化能力。
TransLLM: A Unified Multi-Task Foundation Framework for Urban Transportation via Learnable Prompting
- 通过可学习提示融合时空模型与大语言模型,实现统一框架。
- 在7个数据集、3类任务上表现优于10个基线模型,支持零样本预测。
- 适合需要跨任务部署的智能交通系统开发者使用。
城市交通系统面临交通预测、电动车充电需求预测、出租车调度等多任务挑战。现有方法存在两大局限:小规模深度模型任务专用且依赖大量数据,难以跨场景泛化;而大语言模型虽具自然语言接口灵活性,却难以处理结构化时空数据和交通领域的数值推理。为此,我们提出TransLLM,一种通过可学习提示组合实现时空建模与大语言模型融合的统一基础框架。该框架采用轻量级时空编码器,通过膨胀时间卷积和双邻接图注意力网络捕捉复杂依赖关系,并通过结构化嵌入与大语言模型无缝对接。创新性地设计基于强化学习训练的实例级提示路由机制,根据输入特征动态个性化生成提示,突破固定任务模板限制。框架工作流程为:将时空模式编码为上下文表征,动态组合个性化提示引导大语言模型推理,并通过专用输出层生成任务特定预测。在七个数据集和三类任务上的实验表明,TransLLM在监督与零样本设置下均表现出色,相较十个基线模型具备竞争力,展现出强大的泛化能力和跨任务适应性。代码已开源:https://github.com/BiYunying/TransLLM。
原文摘要 · Abstract (English)
Urban transportation systems encounter diverse challenges across multiple tasks, such as traffic forecasting, electric vehicle (EV) charging demand prediction, and taxi dispatch. Existing approaches suffer from two key limitations: small-scale deep learning models are task-specific and data-hungry, limiting their generalizability across diverse scenarios, while large language models (LLMs), despite offering flexibility through natural language interfaces, struggle with structured spatiotemporal data and numerical reasoning in transportation domains. To address these limitations, we propose TransLLM, a unified foundation framework that integrates spatiotemporal modeling with large language models through learnable prompt composition. Our approach features a lightweight spatiotemporal encoder that captures complex dependencies via dilated temporal convolutions and dual-adjacency graph attention networks, seamlessly interfacing with LLMs through structured embeddings. A novel instance-level prompt routing mechanism, trained via reinforcement learning, dynamically personalizes prompts based on input characteristics, moving beyond fixed task-specific templates. The framework operates by encoding spatiotemporal patterns into contextual representations, dynamically composing personalized prompts to guide LLM reasoning, and projecting the resulting representations through specialized output layers to generate task-specific predictions. Experiments across seven datasets and three tasks demonstrate the exceptional effectiveness of TransLLM in both supervised and zero-shot settings. Compared to ten baseline models, it delivers competitive performance on both regression and planning problems, showing strong generalization and cross-task adaptability. Our code is available at https://github.com/BiYunying/TransLLM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。