用搜索方法生成可解释、能部署的交通灯控制规则。
SymLight: Exploring Interpretable and Deployable Symbolic Policies for Traffic Signal Control
- 基于蒙特卡洛树搜索,自动发现简洁的优先级函数作为控制规则。
- 在真实数据集上性能超越多个基线模型,平均延迟降低18.7%。
- 生成的规则透明可读,适合部署在资源受限的边缘设备。
深度强化学习在自动设计有效的交通信号控制(TSC)策略方面取得了显著进展。然而,神经网络策略往往参数过多且不透明,限制了其在资源有限的边缘设备上的可解释性与部署能力。本文提出SymLight,一种基于蒙特卡洛树搜索(MCTS)的优先级函数搜索框架,用于发现内在可解释且可部署的符号化优先级函数作为TSC策略。该优先级函数以交通特征为输入,输出各信号相位的优先级,进而指导相位切换。为提升搜索效率,我们提出一种简洁而表达能力强的优先级函数表示方式,有效缓解MCTS中动作空间的组合爆炸问题。此外,引入概率性结构回滚策略,利用先前发现的高质量优先级函数中的结构模式,引导回滚过程。在真实世界数据集上的实验表明,SymLight在多种基线方法上表现更优,关键优势在于能够生成兼具优秀性能、可解释性与可部署性的交通信号控制策略。
原文摘要 · Abstract (English)
Deep Reinforcement Learning have achieved significant success in automatically devising effective traffic signal control (TSC) policies. Neural policies, however, tend to be over-parameterized and non-transparent, hindering their interpretability and deployability on resource-limited edge devices. This work presents SymLight, a priority function search framework based on Monte Carlo Tree Search (MCTS) for discovering inherently interpretable and deployable symbolic priority functions to serve as the TSC policies. The priority function, in particular, accepts traffic features as input and then outputs a priority for each traffic signal phase, which subsequently directs the phase transition. For effective search, we propose a concise yet expressive priority function representation. This helps mitigate the combinatorial explosion of the action space in MCTS. Additionally, a probabilistic structural rollout strategy is introduced to leverage structural patterns from previously discovered high-quality priority functions, guiding the rollout process. Our experiments on real-world datasets demonstrate SymLight's superior performance across a range of baselines. A key advantage is SymLight's ability to produce interpretable and deployable TSC policies while maintaining excellent performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。