用深度强化学习让自动驾驶与人工驾驶车辆混合编队更安全稳定。
Platooning Connected, Autonomous, and Human-Driven Vehicles: A Deep Reinforcement Learning-based Approach

- 设计混合编队控制策略,允许非联网车有条件加入车队。
- 动态优化编队结构,抑制速度扰动传播,提升交通稳定性。
- 适合研究智能交通系统或自动驾驶协同的学者与工程师。
传统车辆编队方法主要针对联网车辆,包括联网自动驾驶和联网人工驾驶车辆,未考虑非联网车辆(如非联网自动驾驶或人工驾驶车辆)。这导致现有方法难以反映当前真实交通中混合行驶的复杂情况。为此,本文提出一种混合编队模式,允许非联网车辆有条件加入车队,从而提升编队的多样性与灵活性。然而,未经约束的非联网车辆接入可能导致编队快速扩张,显著加剧扰动在交通流中的传播风险,进一步放大通行能力与稳定性的固有矛盾。为缓解此问题,本文进一步提出一种基于深度强化学习(DRL)的混合编队控制策略。该策略通过多层级状态表示网络融合车辆动力学、编队拓扑及交通流状态,实现通行能力与稳定性的动态权衡。数值仿真表明,所提策略能有效抑制速度扰动传播,动态优化编队结构,显著提升混合交通下的稳定性与安全性,同时降低燃油消耗与排放。
原文摘要 · Abstract (English)
Conventionally, existing vehicle platooning approaches are designed for connected vehicles, typically including connected autonomous vehicles and connected human-driven vehicles. Non-connected vehicles, such as non-connected autonomous or human-driven vehicles, are not incorporated. As a result, these platooning approaches may not properly reflect real-world mixed traffic conditions at the current stage. To address this limitation, this study proposes a hybrid platooning pattern that conditionally permits non-connected vehicles to join platoons, thereby enhancing platooning diversity and flexibility. However, it was found that the unregulated integration of non-connected vehicles can trigger rapid platoon expansion, significantly amplifying the risk of disturbance propagation in traffic flow. This, in turn, exacerbates the inherent conflict between traffic throughput and stability. To mitigate these challenges, this paper further develops a hybrid platooning control strategy based on deep reinforcement learning (DRL). This strategy integrates vehicle dynamics, platoon topology, and traffic flow states through a multi-level state representation network, enabling a dynamic trade-off between traffic capacity and stability. Numerical simulations demonstrate that the proposed strategy effectively suppresses velocity disturbance propagation by dynamically optimizing platoon structures, thereby significantly enhancing the stability and safety of mixed traffic while reducing fuel consumption and emissions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。