用强化学习优化城市交通,显著降低碰撞与排放。
Safety-Prioritized, Reinforcement Learning-Enabled Traffic Flow Optimization in a 3D City-Wide Simulation Environment
- 基于Unity构建3D仿真环境,融合宏观微观交通动态。
- 安全优先的PPO算法使严重碰撞减少超3倍,碳排放降88%。
- 适合交通管理、智能城市研究者参考,推动零事故目标。
交通拥堵与碰撞是全球性的经济、环境与社会挑战。传统交通管理方法在应对复杂动态问题上成效有限。为弥补研究空白,本文开发了三类工具:集成宏观与微观交通动态的三维城市级仿真环境;物理驱动的碰撞模型;以及以安全优先的定制奖励函数强化学习框架。基于Unity引擎的仿真实现直接碰撞建模。采用改进的近端策略优化(PPO)算法,在多项指标上显著优于基线:严重碰撞、车车碰撞数量及总行驶距离均减少超过3倍;燃油效率提升39%,碳排放降低88%。结果验证了在支持“零伤亡”安全理念的城市级3D交通模拟中,融合物理感知、可适应的碰撞建模与合理奖励设计的可行性,为交通信号控制优化、流体调度及温室气体减排提供了有效路径。
原文摘要 · Abstract (English)
Traffic congestion and collisions represent significant economic, environmental, and social challenges worldwide. Traditional traffic management approaches have shown limited success in addressing these complex, dynamic problems. To address the current research gaps, three potential tools are developed: a comprehensive 3D city-wide simulation environment that integrates both macroscopic and microscopic traffic dynamics; a collision model; and a reinforcement learning framework with custom reward functions prioritizing safety over efficiency. Unity game engine-based simulation is used for direct collision modeling. A custom reward enabled reinforcement learning method, proximal policy optimization (PPO) model, yields substantial improvements over baseline results, reducing the number of serious collisions, number of vehicle-vehicle collisions, and total distance travelled by over 3 times the baseline values. The model also improves fuel efficiency by 39% and reduces carbon emissions by 88%. Results establish feasibility for city-wide 3D traffic simulation applications incorporating the vision-zero safety principles of the Department of Transportation, including physics-informed, adaptable, realistic collision modeling, as well as appropriate reward modeling for real-world traffic signal light control towards reducing collisions, optimizing traffic flow and reducing greenhouse emissions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。