arXiv:2412.03925eess.SYcs.LG2024-12被引 6

用摄像头和强化学习优化城市交通信号,实测在感知不全下仍有效。

Traffic Co-Simulation Framework Empowered by Infrastructure Camera Sensing and Reinforcement Learning

  • 融合CARLA与SUMO的协同仿真,用摄像头视觉实时感知车流。
  • MARL在多路口测试中提升整体通行效率,即使检测不准也有效。
  • 验证了算法对传感器故障的鲁棒性,适合真实道路部署。

交通模拟广泛用于优化城市交通流,强化学习(RL)在自动驾驶车辆参与的智能交通系统中展现出自动信号控制的潜力。多智能体强化学习(MARL)尤其适用于通过迭代仿真学习交通灯控制策略。然而,现有方法常假设车辆检测完美,忽视了基础设施可用性和传感器可靠性等现实限制。本研究提出一个集成CARLA与SUMO的协同仿真框架,结合高保真3D建模与大规模交通流模拟。安装在交通灯杆上的摄像头在CARLA环境中使用基于YOLO的计算机视觉系统检测并计数车辆,将实时交通数据输入到SUMO中的自适应信号控制。采用四种不同奖励结构训练的MARL智能体利用此视觉反馈优化信号时序,改善网络级交通流。在多路口测试平台上的实验表明,所提出的MARL方法在基于摄像头的实时检测下能有效提升交通状况。该框架还评估了MARL在传感器故障或稀疏感知下的鲁棒性,并对比了YOLOv5与YOLOv8在车辆检测中的表现。结果表明,尽管更高精度带来更好性能,但即使在不完美检测条件下,MARL智能体仍可实现显著改进,证明其在真实场景中的可扩展性与适应性。

原文摘要 · Abstract (English)

Traffic simulations are commonly used to optimize urban traffic flow, with reinforcement learning (RL) showing promising potential for automated traffic signal control, particularly in intelligent transportation systems involving connected automated vehicles. Multi-agent reinforcement learning (MARL) is particularly effective for learning control strategies for traffic lights in a network using iterative simulations. However, existing methods often assume perfect vehicle detection, which overlooks real-world limitations related to infrastructure availability and sensor reliability. This study proposes a co-simulation framework integrating CARLA and SUMO, which combines high-fidelity 3D modeling with large-scale traffic flow simulation. Cameras mounted on traffic light poles within the CARLA environment use a YOLO-based computer vision system to detect and count vehicles, providing real-time traffic data as input for adaptive signal control in SUMO. MARL agents trained with four different reward structures leverage this visual feedback to optimize signal timings and improve network-wide traffic flow. Experiments in a multi-intersection test-bed demonstrate the effectiveness of the proposed MARL approach in enhancing traffic conditions using real-time camera based detection. The framework also evaluates the robustness of MARL under faulty or sparse sensing and compares the performance of YOLOv5 and YOLOv8 for vehicle detection. Results show that while better accuracy improves performance, MARL agents can still achieve significant improvements with imperfect detection, demonstrating scalability and adaptability for real-world scenarios.

交通信号强化学习视觉感知协同仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。