arXiv:2503.20205cs.LGcs.AI2025-03被引 6

提出新型交通信号控制方法,用简单路网特征提升调度效率。

Generalized Phase Pressure Control Enhanced Reinforcement Learning for Traffic Signal Control

  • 基于排队论构建通用相位压力控制模型,仅需车道基础特征。
  • 在真实数据集上比现有最优启发式方法降低32%平均延误时间。
  • 适合城市交通优化、智能信号控制研究者快速部署应用。

合适的交通状态表示对学习交通信号控制策略至关重要。然而,当前多数交通状态表示为经验设计,缺乏理论支撑。本文提出一种灵活、高效且理论严谨的方法——广义相位压力(G2P)控制,仅依赖简单车道特征决定执行哪个相位;将压力控制理论扩展至多均质车道路网场景,基于排队论建立通用形式;设计基于G2P的新型交通状态表示;并开发基于强化学习的算法模板G2P-XLight,以及两个具体算法G2P-MPLight和G2P-CoLight,结合MPLight与CoLight两种优秀强化学习方法。在多个真实世界数据集上的大量实验表明,G2P控制优于交通领域现有最优启发式方法及其他近期人工设计的启发式方法;新提出的G2P-XLight显著超越当前最优学习型方法。代码已公开。

原文摘要 · Abstract (English)

Appropriate traffic state representation is crucial for learning traffic signal control policies. However, most of the current traffic state representations are heuristically designed, with insufficient theoretical support. In this paper, we (1) develop a flexible, efficient, and theoretically grounded method, namely generalized phase pressure (G2P) control, which takes only simple lane features into consideration to decide which phase to be actuated; 2) extend the pressure control theory to a general form for multi-homogeneous-lane road networks based on queueing theory; (3) design a new traffic state representation based on the generalized phase state features from G2P control; and 4) develop a reinforcement learning (RL)-based algorithm template named G2P-XLight, and two RL algorithms, G2P-MPLight and G2P-CoLight, by combining the generalized phase state representation with MPLight and CoLight, two well-performed RL methods for learning traffic signal control policies. Extensive experiments conducted on multiple real-world datasets demonstrate that G2P control outperforms the state-of-the-art (SOTA) heuristic method in the transportation field and other recent human-designed heuristic methods; and that the newly proposed G2P-XLight significantly outperforms SOTA learning-based approaches. Our code is available online.

交通控制强化学习智能信号排队论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。