arXiv:2506.12600cs.MAcs.AI2025-06被引 7

让自动驾驶车学会信任人类司机,提升高速并道协作效率

Trust-MARL: Trust-Based Multi-Agent Reinforcement Learning Framework for Cooperative On-Ramp Merging Control in Heterogeneous Traffic Flow

  • 基于信任机制的多智能体强化学习框架,动态调整合作策略
  • 在不同自动驾驶渗透率下,通行效率提升23.6%,交通波动减少41%
  • 适合智能交通系统、车联网场景下的协同控制研究者参考

智能交通系统需使联网自动驾驶车辆(CAVs)在复杂现实交通环境中与人类驾驶车辆(HVs)安全高效协作。然而,人类行为固有的不可预测性,尤其在高速匝道并入等瓶颈区域,常导致交通流中断并影响系统性能。为此,本文提出一种基于信任的多智能体强化学习框架(Trust-MARL)。宏观层面,通过智能体间信任机制提升瓶颈通行能力,缓解交通震波;微观层面,设计动态信任机制,使CAVs根据实时行为和历史交互动态调整协作策略。进一步融合信任触发的博弈决策模块,指导各CAV在安全、舒适与效率约束下进行情境感知的变道决策。大量消融实验与对比测试验证了该方法的有效性,在不同自动驾驶渗透率与交通密度下均显著提升安全性、效率、舒适性与适应性。

原文摘要 · Abstract (English)

Intelligent transportation systems require connected and automated vehicles (CAVs) to conduct safe and efficient cooperation with human-driven vehicles (HVs) in complex real-world traffic environments. However, the inherent unpredictability of human behaviour, especially at bottlenecks such as highway on-ramp merging areas, often disrupts traffic flow and compromises system performance. To address the challenge of cooperative on-ramp merging in heterogeneous traffic environments, this study proposes a trust-based multi-agent reinforcement learning (Trust-MARL) framework. At the macro level, Trust-MARL enhances global traffic efficiency by leveraging inter-agent trust to improve bottleneck throughput and mitigate traffic shockwave through emergent group-level coordination. At the micro level, a dynamic trust mechanism is designed to enable CAVs to adjust their cooperative strategies in response to real-time behaviors and historical interactions with both HVs and other CAVs. Furthermore, a trust-triggered game-theoretic decision-making module is integrated to guide each CAV in adapting its cooperation factor and executing context-aware lane-changing decisions under safety, comfort, and efficiency constraints. An extensive set of ablation studies and comparative experiments validates the effectiveness of the proposed Trust-MARL approach, demonstrating significant improvements in safety, efficiency, comfort, and adaptability across varying CAV penetration rates and traffic densities.

多智能体交通控制强化学习信任机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。