用优化引导扩散生成更真实可控的自动驾驶交互场景。
Optimization-Guided Diffusion for Interactive Scene Generation

- 通过约束优化重锚扩散过程,确保轨迹物理合理且行为一致。
- 在nuPlan和Waymo数据集上,有效场景比例从32.35%提升至72.27%。
- 可生成5倍近碰撞帧,适合安全评估与对抗测试场景构建。
真实多智能体驾驶场景对自动驾驶评估至关重要,但关键安全事故样本在现有数据集中稀少且分布不均。数据驱动的场景生成可通过复用驾驶日志低成本合成复杂交通行为,但现有方法常缺乏可控性或产生违反物理/社交规则的样本。本文提出OMEGA——一种无需训练、基于优化引导的扩散生成框架,在采样过程中强制结构一致性和交互感知。该框架通过约束优化重锚每一步反向扩散,引导生成符合物理规律且行为连贯的轨迹。在此基础上,将自车攻击者互动建模为分布空间中的博弈优化,近似纳什均衡以生成真实且具有安全威胁性的对抗场景。在nuPlan和Waymo上的实验表明,OMEGA显著提升生成真实性、一致性与可控性:自由探索场景中有效样本比例由32.35%升至72.27%,可控生成中从11%增至80%。同时可生成5倍于基准的近碰撞帧(时间到碰撞<3秒),且整体场景真实度保持不变。
原文摘要 · Abstract (English)
Realistic and diverse multi-agent driving scenes are crucial for evaluating autonomous vehicles, but safety-critical events which are essential for this task are rare and underrepresented in driving datasets. Data-driven scene generation offers a low-cost alternative by synthesizing complex traffic behaviors from existing driving logs. However, existing models often lack controllability or yield samples that violate physical or social constraints, limiting their usability. We present OMEGA, an optimization-guided, training-free framework that enforces structural consistency and interaction awareness during diffusion-based sampling from a scene generation model. OMEGA re-anchors each reverse diffusion step via constrained optimization, steering the generation towards physically plausible and behaviorally coherent trajectories. Building on this framework, we formulate ego-attacker interactions as a game-theoretic optimization in the distribution space, approximating Nash equilibria to generate realistic, safety-critical adversarial scenarios. Experiments on nuPlan and Waymo show that OMEGA improves generation realism, consistency, and controllability, increasing the ratio of physically and behaviorally valid scenes from 32.35% to 72.27% for free exploration capabilities, and from 11% to 80% for controllability-focused generation. Our approach can also generate $5\times$ more near-collision frames with a time-to-collision under three seconds while maintaining the overall scene realism.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。