用双模驾驶模型生成更高效的安全关键测试场景。
An Evolving Scenario Generation Method based on Dual-modal Driver Model Trained by Multi-Agent Reinforcement Learning
- 基于多智能体强化学习训练双模驾驶模型,支持合作与对抗行为。
- 生成场景效率提升195%,保真度超85%,复杂度提升32.35%。
- 适合自动驾驶安全测试、场景生成研究者使用。
在基于演化场景的自动驾驶测试方法中,背景车辆(BVs)的驾驶行为建模至关重要。本文提出一种基于多智能体强化学习(MARL)训练的双模驾驶模型(Dual-DM),包含非对抗与对抗两种驾驶模式。该模型接入连续仿真交通环境,通过演化场景生成方法生成复杂、多样且具有强交互性的安全关键场景。评估结果表明,其在场景保真度(>85%与真实场景相似)、复杂度(复杂度指标0.45,较两个基线分别提升32.35%和12.5%)无下降的前提下,安全关键场景生成效率(效率指标0.86)相较基线提升195%。统计分析与案例研究进一步验证了其在对抗交互模式上的多样性。Dual-DM显著提升了演化场景生成方法在安全关键场景生成中的性能。
原文摘要 · Abstract (English)
In the autonomous driving testing methods based on evolving scenarios, the construction method of the driver model, which determines the driving maneuvers of background vehicles (BVs) in the scenario, plays a critical role in generating safety-critical scenarios. In particular, the cooperative adversarial driving characteristics between BVs can contribute to the efficient generation of safety-critical scenarios with high testing value. In this paper, a multi-agent reinforcement learning (MARL) method is used to train and generate a dual-modal driver model (Dual-DM) with non-adversarial and adversarial driving modalities. The model is then connected to a continuous simulated traffic environment to generate complex, diverse and strong interactive safety-critical scenarios through evolving scenario generation method. After that, the generated evolving scenarios are evaluated in terms of fidelity, test efficiency, complexity and diversity. Results show that without performance degradation in scenario fidelity (>85% similarity to real-world scenarios) and complexity (complexity metric: 0.45, +32.35% and +12.5% over two baselines), Dual-DM achieves a substantial enhancement in the efficiency of generating safety-critical scenarios (efficiency metric: 0.86, +195% over two baselines). Furthermore, statistical analysis and case studies demonstrate the diversity of safety-critical evolving scenarios generated by Dual-DM in terms of the adversarial interaction patterns. Therefore, Dual-DM can greatly improve the performance of the generation of safety-critical scenarios through evolving scenario generation method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。