arXiv:2603.02542cs.AI2026-03

用大模型生成安全驾驶场景,让指令可控又真实。

AnchorDrive: LLM Scenario Rollout with Anchor-Guided Diffusion Regeneration for Safety-Critical Scenario Generation

  • 先用大模型按语言指令生成驾驶动作,再用扩散模型优化轨迹真实性。
  • 在highD数据集上,场景关键性、真实性和可控性均优于现有方法。
  • 适合自动驾驶安全评估,尤其需要精准指令控制的场景设计。

自动驾驶系统需在安全关键场景下进行充分评估以确保安全与鲁棒性。然而,此类场景在真实驾驶数据中罕见且难以采集,需依赖仿真合成。现有方法在可控性与真实性方面存在局限。大语言模型擅长根据自然语言指令进行可控生成,而扩散模型更擅长生成符合真实驾驶分布的轨迹。为此,我们提出AnchorDrive,一种两阶段的安全关键场景生成框架。第一阶段,在闭环仿真中部署大语言模型作为驾驶员代理,基于自然语言约束推理并迭代输出控制指令;计划评估器对指令进行审查并提供修正反馈,实现语义可控的场景生成。第二阶段,大语言模型从第一阶段轨迹中提取关键锚点作为引导目标,结合其他引导项,驱动扩散模型再生完整轨迹,提升真实性同时保留用户指定意图。在highD数据集上的实验表明,AnchorDrive在关键性、真实性和可控性方面均表现更优,验证了其生成可控且真实安全关键场景的有效性。

原文摘要 · Abstract (English)

Autonomous driving systems require comprehensive evaluation in safety-critical scenarios to ensure safety and robustness. However, such scenarios are rare and difficult to collect from real-world driving data, necessitating simulation-based synthesis. Yet, existing methods often exhibit limitations in both controllability and realism. From a capability perspective, LLMs excel at controllable generation guided by natural language instructions, while diffusion models are better suited for producing trajectories consistent with realistic driving distributions. Leveraging their complementary strengths, we propose AnchorDrive, a two-stage safety-critical scenario generation framework. In the first stage, we deploy an LLM as a driver agent within a closed-loop simulation, which reasons and iteratively outputs control commands under natural language constraints; a plan assessor reviews these commands and provides corrective feedback, enabling semantically controllable scenario generation. In the second stage, the LLM extracts key anchor points from the first-stage trajectories as guidance objectives, which jointly with other guidance terms steer the diffusion model to regenerate complete trajectories with improved realism while preserving user-specified intent. Experiments on the highD dataset demonstrate that AnchorDrive achieves superior overall performance in criticality, realism, and controllability, validating its effectiveness for generating controllable and realistic safety-critical scenarios.

自动驾驶场景生成扩散模型大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。