arXiv:2503.15049cs.ROcs.AI2025-03被引 7

提出可生成多样人类驾驶行为的仿真框架,提升自动驾驶测试真实性。

HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generation

  • 按安全特征聚类驾驶轨迹,分风格学习奖励函数
  • 多智能体强化学习生成策略,目标达成率90.96%优于旧方法20%以上
  • 适合自动驾驶仿真测试,尤其关注行为多样性与泛化能力

基于仿真的测试已成为验证自动驾驶车辆的关键工具。然而,当前的确定性及基于模仿学习的驾驶员模型难以捕捉人类驾驶行为的多样性。针对此问题,我们提出HAD-Gen,一个通用的交通场景生成框架,用于模拟多样且类人的驾驶行为。该框架首先根据安全特征将车辆轨迹数据聚类为不同驾驶风格;随后在每个聚类上使用最大熵逆强化学习,学习对应各风格的奖励函数;再结合离线强化学习预训练与多智能体强化学习算法,获得通用且鲁棒的驾驶策略。多视角仿真结果表明,所提框架能生成具有强泛化能力的多样化人类驾驶行为。在泛化测试中,目标达成率达90.96%,偏离道路率为2.08%,碰撞率为6.91%,目标达成性能优于先前方法超过20%。源代码已发布于https://github.com/RoboSafe-Lab/Sim4AD。

原文摘要 · Abstract (English)

Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the variability of human-like driving behavior. Given these challenges, we propose HAD-Gen, a general framework for realistic traffic scenario generation that simulates diverse human-like driving behaviors. The framework first clusters the vehicle trajectory data into different driving styles according to safety features. It then employs maximum entropy inverse reinforcement learning on each of the clusters to learn the reward function corresponding to each driving style. Using these reward functions, the method integrates offline reinforcement learning pre-training and multi-agent reinforcement learning algorithms to obtain general and robust driving policies. Multi-perspective simulation results show that our proposed scenario generation framework can simulate diverse, human-like driving behaviors with strong generalization capability. The proposed framework achieves a 90.96% goal-reaching rate, an off-road rate of 2.08%, and a collision rate of 6.91% in the generalization test, outperforming prior approaches by over 20% in goal-reaching performance. The source code is released at https://github.com/RoboSafe-Lab/Sim4AD.

自动驾驶行为建模强化学习仿真测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。