arXiv:2412.18086cs.ROcs.AI2024-12AAAI被引 11

用大模型自动生成交通风险场景,提升自动驾驶规划器的鲁棒性。

Generating Traffic Scenarios via In-Context Learning to Learn Better Motion Planner

  • 通过文本描述生成脚本,驱动模拟器自动构造复杂交通场景。
  • 合成数据训练的规划器在测试中显著优于仅用真实数据训练的版本。
  • 适合自动驾驶安全验证、仿真数据增强的研究者与工程师。

运动规划是自动驾驶的核心组件。当前先进规划器依赖精心标注的数据集,但这类数据不仅标注成本高,且难以覆盖罕见的关键场景。忽略此类场景会带来测试阶段的重大风险。传统方法需人工编程生成场景(如使用CARLA模拟器),但代价高昂。为此,我们提出一种低成本生成多样化关键交通场景的方法。首先将交通场景表示为脚本,由模拟器执行生成具体场景;其次开发基于大语言模型的机制,通过上下文学习将用户提供的文本描述转化为脚本。生成的脚本输入模拟器后,产出对应交通场景。利用该方法生成的大量安全敏感场景作为合成训练数据,我们对现有运动规划器在真实数据、合成数据及二者结合的数据上进行训练。实验表明,使用合成数据训练的规划器性能显著优于仅基于真实数据训练的版本,验证了合成数据的有效性与生成方法的实用性。代码已公开于 https://ezharjan.github.io/AutoSceneGen。

原文摘要 · Abstract (English)

Motion planning is a crucial component in autonomous driving. State-of-the-art motion planners are trained on meticulously curated datasets, which are not only expensive to annotate but also insufficient in capturing rarely seen critical scenarios. Failing to account for such scenarios poses a significant risk to motion planners and may lead to incidents during testing. An intuitive solution is to manually compose such scenarios by programming and executing a simulator (e.g., CARLA). However, this approach incurs substantial human costs. Motivated by this, we propose an inexpensive method for generating diverse critical traffic scenarios to train more robust motion planners. First, we represent traffic scenarios as scripts, which are then used by the simulator to generate traffic scenarios. Next, we develop a method that accepts user-specified text descriptions, which a Large Language Model translates into scripts using in-context learning. The output scripts are sent to the simulator that produces the corresponding traffic scenarios. As our method can generate abundant safety-critical traffic scenarios, we use them as synthetic training data for motion planners. To demonstrate the value of generated scenarios, we train existing motion planners on our synthetic data, real-world datasets, and a combination of both. Our experiments show that motion planners trained with our data significantly outperform those trained solely on real-world data, showing the usefulness of our synthetic data and the effectiveness of our data generation method. Our source code is available at https://ezharjan.github.io/AutoSceneGen.

自动驾驶场景生成大模型仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。