攻击生成式世界模型的物理条件通道,诱导错误决策且保持画面真实
When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models
- 通过扰动地图和3D物体特征等物理条件通道实现攻击
- 攻击成功率55%,使检测性能下降4%,规划性能恶化20%
- 适用于自动驾驶系统安全评估与防御研究
生成式世界模型(WMs)被广泛用于生成可控、传感器驱动的驾驶视频,但其对物理先验的依赖暴露了新的攻击面。本文提出首个白盒世界模型攻击方法PhysCond-WMA,通过扰动物理条件通道(如HDMap嵌入和3D框特征),在保持视觉保真度的前提下引发语义、逻辑或决策层面的失真。该方法分两阶段优化:(1) 质量保持引导阶段,将反向扩散损失控制在可校准阈值以下;(2) 动量引导去噪阶段,沿去噪轨迹累积目标对齐梯度,实现稳定且时序一致的语义偏移。实验表明,本方法平均使FID上升约9%,FVD上升约3.9%。在定向攻击下,攻击成功率达0.55。下游研究表明,使用受攻击视频训练会使3D检测性能下降约4%,开环规划性能恶化约20%。首次揭示并量化了生成式世界模型的安全漏洞,推动更全面的安全检测机制发展。
原文摘要 · Abstract (English)
Generative world models (WMs) are increasingly used to synthesize controllable, sensor-conditioned driving videos, yet their reliance on physical priors exposes novel attack surfaces. In this paper, we present Physical-Conditioned World Model Attack (PhysCond-WMA), the first white-box world model attack that perturbs physical-condition channels, such as HDMap embeddings and 3D-box features, to induce semantic, logic, or decision-level distortion while preserving perceptual fidelity. PhysCond-WMA is optimized in two stages: (1) a quality-preserving guidance stage that constrains reverse-diffusion loss below a calibrated threshold, and (2) a momentum-guided denoising stage that accumulates target-aligned gradients along the denoising trajectory for stable, temporally coherent semantic shifts. Extensive experimental results demonstrate that our approach remains effective while increasing FID by about 9% on average and FVD by about 3.9% on average. Under the targeted attack setting, the attack success rate (ASR) reaches 0.55. Downstream studies further show tangible risk, which using attacked videos for training decreases 3D detection performance by about 4%, and worsens open-loop planning performance by about 20%. These findings has for the first time revealed and quantified security vulnerabilities in generative world models, driving more comprehensive security checkers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。