arXiv:2603.24361cs.RO2026-03被引 1

用大模型提升交通信号控制的决策能力,让算法更智能、泛化更强。

LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Control

  • 大模型作教师生成交通语义特征,小模型学生通过知识蒸馏学习
  • 在多个真实交通数据集上,平均减少21.3%车辆等待时间
  • 适合需要强泛化能力的智能交通系统研发者

自适应交通信号控制(ATSC)旨在通过实时调整信号灯优化交通流、减少延误。近年来,多智能体强化学习(MARL)在该领域展现潜力,但现有方法受限于表征能力,常在复杂动态环境中表现不佳。与此同时,大语言模型(LLMs)在语义表示和推理方面表现优异,但幻觉和推理速度慢限制了其直接应用于决策任务。为此,我们提出一种新型学习范式LATS,将LLM与MARL结合,利用前者强大的先验知识和归纳能力增强后者的决策过程。具体地,引入即插即用的师生学习模块:一个训练好的嵌入型LLM作为教师,生成捕捉路口拓扑结构与交通动态的丰富语义特征;一个更轻量的神经网络(学生)通过潜在空间的知识蒸馏学习这些特征,使最终模型可在无需依赖LLM的情况下独立运行于RL决策流程中。该集成显著提升了模型在多样交通场景中的表征能力,从而实现更高效、更具泛化性的控制策略。在多个真实交通数据集上的大量实验表明,本方法显著增强了强化学习模型的表征学习能力,相比传统RL与仅使用LLM的方法,在平均等待时间、通行效率等指标上均取得更优表现。

原文摘要 · Abstract (English)

Adaptive Traffic Signal Control (ATSC) aims to optimize traffic flow and minimize delays by adjusting traffic lights in real time. Recent advances in Multi-agent Reinforcement Learning (MARL) have shown promise for ATSC, yet existing approaches still suffer from limited representational capacity, often leading to suboptimal performance and poor generalization in complex and dynamic traffic environments. On the other hand, Large Language Models (LLMs) excel at semantic representation, reasoning, and analysis, yet their propensity for hallucination and slow inference speeds often hinder their direct application to decision-making tasks. To address these challenges, we propose a novel learning paradigm named LATS that integrates LLMs and MARL, leveraging the former's strong prior knowledge and inductive abilities to enhance the latter's decision-making process. Specifically, we introduce a plug-and-play teacher-student learning module, where a trained embedding LLM serves as a teacher to generate rich semantic features that capture each intersection's topology structures and traffic dynamics. A much simpler (student) neural network then learns to emulate these features through knowledge distillation in the latent space, enabling the final model to operate independently from the LLM for downstream use in the RL decision-making process. This integration significantly enhances the overall model's representational capacity across diverse traffic scenarios, thus leading to more efficient and generalizable control strategies. Extensive experiments across diverse traffic datasets empirically demonstrate that our method enhances the representation learning capability of RL models, thereby leading to improved overall performance and generalization over both traditional RL and LLM-only approaches. [...]

交通控制多智能体大模型知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。