arXiv:2601.11809cs.AI2026-01

提出多智能体强化学习模型,提升混合交通中自动驾驶车的协同编队率。

Multi-agent DRL-based Lane Change Decision Model for Cooperative Platooning in Mixed Traffic

  • 用CNN-QMIX框架处理动态交通数据,实现多车协同变道决策
  • 在低渗透率下使协同编队率提升26.2%,优于传统规则模型
  • 适合关注自动驾驶车早期部署协同优化的研究者与工程师

联网自动驾驶车辆(CAVs)具备相互通信与协调能力,可实现协同编队以提升能效与交通流。然而,在自动驾驶车初期部署阶段,其稀疏分布于人类驾驶车辆之间,难以形成有效编队。为此,本文提出一种融合多智能体强化学习的混合变道决策模型,旨在提高CAVs参与协同编队的比例并最大化其效益。该模型采用QMIX框架,结合卷积神经网络(CNN-QMIX)处理交通数据,可在不同数量的CAVs存在时做出最优决策。同时,设计了轨迹规划器与模型预测控制器,确保变道过程平滑安全。模型在微观仿真环境中,针对不同CAV市场渗透率进行训练与评估。结果表明,该模型能有效应对交通代理数量波动,在低渗透率场景下将协同编队率提升至26.2%,显著优于基准规则模型,展现出在自动驾驶车早期部署阶段优化协作与交通动态的巨大潜力。

原文摘要 · Abstract (English)

Connected automated vehicles (CAVs) possess the ability to communicate and coordinate with one another, enabling cooperative platooning that enhances both energy efficiency and traffic flow. However, during the initial stage of CAV deployment, the sparse distribution of CAVs among human-driven vehicles reduces the likelihood of forming effective cooperative platoons. To address this challenge, this study proposes a hybrid multi-agent lane change decision model aimed at increasing CAV participation in cooperative platooning and maximizing its associated benefits. The proposed model employs the QMIX framework, integrating traffic data processed through a convolutional neural network (CNN-QMIX). This architecture addresses a critical issue in dynamic traffic scenarios by enabling CAVs to make optimal decisions irrespective of the varying number of CAVs present in mixed traffic. Additionally, a trajectory planner and a model predictive controller are designed to ensure smooth and safe lane-change execution. The proposed model is trained and evaluated within a microsimulation environment under varying CAV market penetration rates. The results demonstrate that the proposed model efficiently manages fluctuating traffic agent numbers, significantly outperforming the baseline rule-based models. Notably, it enhances cooperative platooning rates up to 26.2\%, showcasing its potential to optimize CAV cooperation and traffic dynamics during the early stage of deployment.

自动驾驶多智能体强化学习协同编队

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。