arXiv:2412.16225eess.SYcs.AI2024-12

用贝叶斯评鉴调优与自适应压力机制,提升多路口信号灯控制合理性。

Bayesian Critique-Tune-Based Reinforcement Learning with Adaptive Pressure for Multi-Intersection Traffic Signal Control

  • 设计双层贝叶斯结构,评估并修正强化学习策略的不合理信任
  • 在真实数据集上降低平均队列长度9.60%、等待时间15.28%
  • 适合交通信号优化与智能交通系统研究者参考

自适应交通信号控制系统是智能交通的关键,能有效缓解城市交通拥堵。尽管基于强化学习的方法在交通信号控制中表现良好,但现有方法仍易生成不合理策略。本文提出一种面向多路口信号控制的贝叶斯评鉴调优增强型强化学习方法(BCT-APLight)。该方法采用两层贝叶斯结构的评鉴调优(CT)框架:基于贝叶斯推断的评鉴层评估策略可信度;当评估为负面时,基于贝叶斯决策的调优层通过最小化后验风险进行策略修正。同时引入注意力机制的自适应压力(AP)模块,动态加权各车道车辆队列,提升网络内交通流表示的合理性。在多种路口布局的仿真环境中,基于七个真实世界数据集的实验表明,相较于现有最优方法,BCT-APLight将平均队列长度减少9.60%,平均等待时间降低15.28%。

原文摘要 · Abstract (English)

Adaptive Traffic Signal Control (ATSC) system is a critical component of intelligent transportation, with the capability to significantly alleviate urban traffic congestion. Although reinforcement learning (RL)-based methods have demonstrated promising performance in achieving ATSC, existing methods are still prone to making unreasonable policies. Therefore, this paper proposes a novel Bayesian Critique-Tune-Based Reinforcement Learning with Adaptive Pressure for multi-intersection signal control (BCT-APLight). In BCT-APLight, the Critique-Tune (CT) framework, a two-layer Bayesian structure is designed to refine the excessive trust of RL policies. Specifically, the Bayesian inference-based Critique Layer provides effective evaluations of the credibility of policies; the Bayesian decision-based Tune Layer fine-tunes policies by minimizing the posterior risks when the evaluations are negative. Meanwhile, an attention-based Adaptive Pressure (AP) mechanism is designed to effectively weight the vehicle queues in each lane, thereby enhancing the rationality of traffic movement representation within the network. Equipped with the CT framework and AP mechanism, BCT-APLight effectively enhances the reasonableness of RL policies. Extensive experiments conducted with a simulator across a range of intersection layouts demonstrate that BCT-APLight is superior to other state-of-the-art (SOTA) methods on seven real-world datasets. Specifically, BCT-APLight decreases average queue length by \textbf{\(\boldsymbol{9.60\%}\)} and average waiting time by \textbf{\(\boldsymbol{15.28\%}\)}.

交通信号控制强化学习贝叶斯方法多路口协同

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。