用大模型生成无限多样交通场景,提升自动驾驶训练效果
DriveGen: Towards Infinite Diverse Traffic Scenarios with Large Models
- 分两阶段生成:先用大语言模型设计地图车辆,再用视觉语言模型规划轨迹
- 生成场景多样性超越现有基线,且保持高真实度,下游算法性能更优
- 可自动挖掘驾驶失败案例生成极限场景,适合自动驾驶算法优化使用
微观交通仿真已成为自动驾驶训练与测试的重要工具。尽管近年数据驱动方法提升了行为生成的真实性,但其学习仍主要依赖单一真实世界数据集,限制了场景多样性,阻碍下游算法优化。本文提出DriveGen,一种基于大模型的新型交通仿真框架,支持生成更丰富的交通场景并实现定制化设计。DriveGen包含两个内部阶段:初始化阶段利用大语言模型和检索技术生成地图与车辆资产;滚动阶段通过视觉语言模型和专为路径规划设计的扩散模型输出带有选定路点目标的轨迹。该两阶段流程充分利用大模型对驾驶行为的高层认知与推理能力,在超越数据集范围的同时保持高真实性。为进一步支持下游优化,我们还开发了DriveGen-CS,一个自动生成极端场景的流水线,利用驾驶算法失败作为额外提示知识,无需重训或微调即可生成挑战性场景。实验表明,生成场景与极端案例优于当前最先进基线。下游实验进一步验证,DriveGen合成的交通流能更好优化典型驾驶算法性能,证明了该框架的有效性。
原文摘要 · Abstract (English)
Microscopic traffic simulation has become an important tool for autonomous driving training and testing. Although recent data-driven approaches advance realistic behavior generation, their learning still relies primarily on a single real-world dataset, which limits their diversity and thereby hinders downstream algorithm optimization. In this paper, we propose DriveGen, a novel traffic simulation framework with large models for more diverse traffic generation that supports further customized designs. DriveGen consists of two internal stages: the initialization stage uses large language model and retrieval technique to generate map and vehicle assets; the rollout stage outputs trajectories with selected waypoint goals from visual language model and a specific designed diffusion planner. Through this two-staged process, DriveGen fully utilizes large models' high-level cognition and reasoning of driving behavior, obtaining greater diversity beyond datasets while maintaining high realism. To support effective downstream optimization, we additionally develop DriveGen-CS, an automatic corner case generation pipeline that uses failures of the driving algorithm as additional prompt knowledge for large models without the need for retraining or fine-tuning. Experiments show that our generated scenarios and corner cases have a superior performance compared to state-of-the-art baselines. Downstream experiments further verify that the synthesized traffic of DriveGen provides better optimization of the performance of typical driving algorithms, demonstrating the effectiveness of our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。