生成逼真且具有挑战性的驾驶视频,用于测试自动驾驶系统安全性。
Challenger: Affordable Adversarial Driving Video Generation
- 通过物理感知的多轮轨迹优化与定制评分函数,生成真实交通行为。
- 在nuScenes数据集上生成多种激进驾驶场景,使主流模型碰撞率显著上升。
- 适合自动驾驶安全测试、对抗样本研究者使用。
近年来,逼真驾驶视频生成取得了显著进展,但现有方法主要关注常规非对抗性场景。而生成对抗性驾驶场景的研究多基于抽象轨迹或鸟瞰图(BEV)表示,难以生成能真正考验自动驾驶(AD)系统的逼真传感器数据。本文提出Challenger框架,可生成物理合理且逼真逼真的对抗性驾驶视频。其核心挑战在于同时优化交通交互与高保真传感器观测。Challenger通过两项技术实现低成本:(1)物理感知的多轮轨迹精炼过程,缩小候选对抗性操作范围;(2)定制化的轨迹评分函数,鼓励现实且具有对抗性的行为,同时兼容下游视频生成。在nuScenes数据集上的测试表明,Challenger生成了包括切入、急变道、尾随、盲区侵入在内的多样化激进驾驶场景,并渲染为多视角逼真视频。大量评估显示,这些场景显著提升主流端到端AD模型(UniAD、VAD、SparseDrive、DiffusionDrive)的碰撞率,且针对某一模型发现的对抗行为具有跨模型迁移能力。
原文摘要 · Abstract (English)
Generating photorealistic driving videos has seen significant progress recently, but current methods largely focus on ordinary, non-adversarial scenarios. Meanwhile, efforts to generate adversarial driving scenarios often operate on abstract trajectory or BEV representations, falling short of delivering realistic sensor data that can truly stress-test autonomous driving (AD) systems. In this work, we introduce Challenger, a framework that produces physically plausible yet photorealistic adversarial driving videos. Generating such videos poses a fundamental challenge: it requires jointly optimizing over the space of traffic interactions and high-fidelity sensor observations. Challenger makes this affordable through two techniques: (1) a physics-aware multi-round trajectory refinement process that narrows down candidate adversarial maneuvers, and (2) a tailored trajectory scoring function that encourages realistic yet adversarial behavior while maintaining compatibility with downstream video synthesis. As tested on the nuScenes dataset, Challenger generates a diverse range of aggressive driving scenarios-including cut-ins, sudden lane changes, tailgating, and blind spot intrusions-and renders them into multiview photorealistic videos. Extensive evaluations show that these scenarios significantly increase the collision rate of state-of-the-art end-to-end AD models (UniAD, VAD, SparseDrive, and DiffusionDrive), and importantly, adversarial behaviors discovered for one model often transfer to others.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。