arXiv:2605.20255cs.LGcs.AI2026-05中稿 · ICRA

用多智能体强化学习让自动驾驶车和行人共同训练,更真实模拟乱穿马路场景。

Multi-Agent Reinforcement Learning for Safe Autonomous Driving Under Pedestrian Behavioral Uncertainty

论文配图:Multi-Agent Reinforcement Learning for Safe Autonomous Driving Under Pedestrian Behavioral Uncertainty
图 1 · 摘自论文原文
  • 行人与车联合用MAPPO训练,行为由隐藏性格特质决定
  • 碰撞率降低30%,乱穿马路占62%事故但仅13%事件
  • 车辆对乱穿者反应慢,速度差达2.65 m/s,体现预判不足

自驾车仿真测试通常依赖固定脚本化行人模型,无法反映真实过街行为的多样性与不确定性,尤其在难以观测的乱穿行为上表现不佳。本文提出通过多智能体强化学习(MARL)联合训练自动驾驶车与12名行人,行人路径采用脚本化Dijkstra规划,但是否穿越由每轮初始化的隐含性格特质决定,车辆无法观测。使用多智能体近端策略优化(MAPPO)进行联合训练,在500次评估中,协同训练的自动驾驶车达成78%目标成功率,碰撞率14%,优于最佳规则基线的35%/33%。速度差异度量显示,当距离小于3米时,车辆对乱穿者行驶速度比对正规过街者快2.65 m/s,表明缺乏提前预判。乱穿行为占总过街事件的13%,却导致62%的碰撞;相比单智能体强化学习,联合训练使碰撞减少30%,因行人学会在车辆高速接近时选择等待。

原文摘要 · Abstract (English)

Simulation-based testing of self-driving cars (SDCs) typically relies on scripted pedestrian models that do not capture the heterogeneity and uncertainty of real crossing behavior, limiting the realism of safety assessments, especially for jaywalking, which is governed by latent personality traits the vehicle cannot observe. We hypothesize that jointly training pedestrians and the SDC with multi-agent reinforcement learning (MARL) yields more realistic interaction scenarios than training against fixed pedestrian policies, and that the behavior gap between predictable and unpredictable crossings can be measured directly from trajectories. We co-train an SDC and 12 pedestrians using Multi-Agent Proximal Policy Optimization (MAPPO): pedestrian locomotion follows scripted Dijkstra pathfinding while an RL policy controls high-level go/wait decisions, and jaywalking probability depends on a per-pedestrian trait sampled at episode start and hidden from the SDC. In 500-episode evaluations, the co-trained SDC reached 78% of goals with a 14% collision rate, versus 35%/33% for the best rule-based baseline. A speed differential metric shows the SDC traveled 2.65 m/s faster near jaywalkers than near crosswalk users at close range (0-3 m), indicating jaywalking encounters were not anticipated. Jaywalking was 13% of crossing events but 62% of collisions, and co-training reduced collisions by 30% relative to single-agent RL as pedestrians learned to wait when the SDC approached at speed.

自动驾驶多智能体行人预测强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。