arXiv:2502.14706cs.AIcs.RO2025-02被引 23

用自对弈扩展训练可靠驾驶仿真代理,1天完成训练,99.8%任务成功率。

Building reliable sim driving agents by scaling self-play

  • 通过自对弈在数千场景上训练,模拟人类感知与控制限制。
  • 在1万组未见场景中达成99.8%目标完成率,碰撞+偏离道路率低于0.8%。
  • 可快速微调适应新场景,适合自动驾驶系统测试与验证。

仿真代理对于设计和测试与人类交互的系统(如自动驾驶汽车)至关重要。这些代理用于评估性能、压力测试系统极限,但均需满足可靠性要求:行为应符合预期,尽量避免碰撞等不良结果,以保证分析信噪比。为此,我们提出将自对弈扩展至数千个场景,在半真实人类感知与控制限制下基于Waymo Open Motion Dataset进行训练。单块GPU从零开始训练,一天内解决全部训练集。模型泛化至未见测试场景,10,000个保留场景中达成99.8%目标完成率,总碰撞与偏离道路事件低于0.8%。超出分布外场景也展现部分鲁棒性,经分钟级微调后接近完美表现。我们开源预训练代理,并集成至批处理多智能体仿真器。行为演示可访问 https://sites.google.com/view/reliable-sim-agents,代码开源地址为 https://github.com/Emerge-Lab/gpudrive。

原文摘要 · Abstract (English)

Simulation agents are essential for designing and testing systems that interact with humans, such as autonomous vehicles (AVs). These agents serve various purposes, from benchmarking AV performance to stress-testing system limits, but all applications share one key requirement: reliability. To enable sound experimentation, a simulation agent must behave as intended. It should minimize actions that may lead to undesired outcomes, such as collisions, which can distort the signal-to-noise ratio in analyses. As a foundation for reliable sim agents, we propose scaling self-play to thousands of scenarios on the Waymo Open Motion Dataset under semi-realistic limits on human perception and control. Training from scratch on a single GPU, our agents solve almost the full training set within a day. They generalize to unseen test scenes, achieving a 99.8% goal completion rate with less than 0.8% combined collision and off-road incidents across 10,000 held-out scenarios. Beyond in-distribution generalization, our agents show partial robustness to out-of-distribution scenes and can be fine-tuned in minutes to reach near-perfect performance in such cases. We open-source the pre-trained agents and integrate them with a batched multi-agent simulator. Demonstrations of agent behaviors can be viewed at https://sites.google.com/view/reliable-sim-agents, and we open-source our agents at https://github.com/Emerge-Lab/gpudrive.

自动驾驶仿真代理自对弈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。