用多目标强化学习平衡交通效率、公平与安全,缓解低需求车道拥堵。
Multi-Objective Reinforcement Learning for Large-Scale Mixed Traffic Control
- 分层框架结合局部路口控制与全局路径规划,实现协同优化。
- 平均等待时间减少53%,最长饥饿度降低86%,冲突率下降86%。
- 适合高自动驾驶车辆渗透场景,推动公平混合交通落地。
有效混合交通控制需兼顾效率、公平与安全。现有方法虽能优化效率并保障安全,却缺乏公平服务机制,导致低需求方向车辆系统性饥饿。本文提出分层框架:局部采用多目标强化学习控制路口,全局通过战略路径规划协调网络。引入冲突威胁向量,为智能体提供显式风险信号以主动避险;设计队列均等惩罚项,确保各交通流服务公平。在真实路网中,不同自动驾驶车辆(RV)渗透率下的实验表明,本方法可使平均等待时间最多减少53%,最大饥饿程度降低86%,冲突率下降86%,同时保持燃油效率。分析显示,战略路径规划效果随RV渗透率提升而增强,在高自动化水平下价值愈发显著。结果证明,通过精心设计的奖励函数与战略路由结合,多目标优化可在公平性和安全性上带来显著提升,对实现公平混合自主交通部署至关重要。
原文摘要 · Abstract (English)
Effective mixed traffic control requires balancing efficiency, fairness, and safety. Existing approaches excel at optimizing efficiency and enforcing safety constraints but lack mechanisms to ensure equitable service, resulting in systematic starvation of vehicles on low-demand approaches. We propose a hierarchical framework combining multi-objective reinforcement learning for local intersection control with strategic routing for network-level coordination. Our approach introduces a Conflict Threat Vector that provides agents with explicit risk signals for proactive conflict avoidance, and a queue parity penalty that ensures equitable service across all traffic streams. Extensive experiments on a real-world network across different robot vehicle (RV) penetration rates demonstrate substantial improvements: up to 53% reductions in average wait time, up to 86% reductions in maximum starvation, and up to 86\% reduction in conflict rate compared to baselines, while maintaining fuel efficiency. Our analysis reveals that strategic routing effectiveness scales with RV penetration, becoming increasingly valuable at higher autonomy levels. The results demonstrate that multi-objective optimization through well-curated reward functions paired with strategic RV routing yields significant benefits in fairness and safety metrics critical for equitable mixed-autonomy deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。