arXiv:2410.18786cs.AI2024-10被引 2

用神经蒙特卡洛树搜索优化自动驾驶车辆无信号交叉口通行调度。

Applying Neural Monte Carlo Tree Search to Unsignalized Multi-intersection Scheduling for Autonomous Vehicles

  • 将车辆队列请求转化为类棋盘问题,用神经蒙特卡洛树搜索寻找最优通行方案。
  • 在单个四向交叉口上,未见场景解决率达95%,通行时间减少43%~52%。
  • 适用于复杂多交叉口网络,优于现有强化学习交通灯控制方法。

自主系统动态调度共享资源是NP难问题,在高动态环境下,到达请求需持续调度且满足强安全与时间约束。以无信号交叉口为例,自动驾驶车辆进入潜在冲突区域需动态调度。本文将神经蒙特卡洛树搜索(NMCTS)应用于车队穿越无信号交叉口的调度任务。关键在于引入转换模型,将连续的车辆队列道路空间请求序列映射为类棋盘问题,并用NMCTS搜索过去分配情境下的最优空间分配方案。为优化搜索,采用优先重采样与并行NMCTS(PNMCTS)提升训练数据质量;为优化训练,使用课程学习策略逐步训练代理应对更复杂的棋盘,最终处理重叠棋盘(代表繁忙交叉口)。在单个四向无信号交叉口模拟中,PNMCTS解决了95%未见场景,轻/重交通下通行时间分别减少43%和52%;在3×3多交叉口网络中,全系统由PNMCTS控制时轻交通保持畅通,重交通下平均行程时间优于最先进强化学习交通灯控制器74.5%,总吞吐量提升16%。

原文摘要 · Abstract (English)

Dynamic scheduling of access to shared resources by autonomous systems is a challenging problem, characterized as being NP-hard. The complexity of this task leads to a combinatorial explosion of possibilities in highly dynamic systems where arriving requests must be continuously scheduled subject to strong safety and time constraints. An example of such a system is an unsignalized intersection, where automated vehicles' access to potential conflict zones must be dynamically scheduled. In this paper, we apply Neural Monte Carlo Tree Search (NMCTS) to the challenging task of scheduling platoons of vehicles crossing unsignalized intersections. Crucially, we introduce a transformation model that maps successive sequences of potentially conflicting road-space reservation requests from platoons of vehicles into a series of board-game-like problems and use NMCTS to search for solutions representing optimal road-space allocation schedules in the context of past allocations. To optimize search, we incorporate a prioritized re-sampling method with parallel NMCTS (PNMCTS) to improve the quality of training data. To optimize training, a curriculum learning strategy is used to train the agent to schedule progressively more complex boards culminating in overlapping boards that represent busy intersections. In a busy single four-way unsignalized intersection simulation, PNMCTS solved 95\% of unseen scenarios, reducing crossing time by 43\% in light and 52\% in heavy traffic versus first-in, first-out control. In a 3x3 multi-intersection network, the proposed method maintained free-flow in light traffic when all intersections are under control of PNMCTS and outperformed state-of-the-art RL-based traffic-light controllers in average travel time by 74.5\% and total throughput by 16\% in heavy traffic.

自动驾驶路径规划强化学习交通调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。