AutoAWG生成逼真恶劣天气自动驾驶视频,提升感知模型鲁棒性。
AutoAWG: Adverse Weather Generation with Adaptive Multi-Controls for Automotive Videos

- 多控制自适应融合,平衡天气风格与关键目标保真度。
- 静态图构建时序序列,减少对合成数据依赖,FID降50%。
- 掩码训练提升长时生成稳定性,适合自动驾驶感知研究者。
恶劣天气下感知鲁棒性仍是自动驾驶的关键挑战,核心瓶颈在于真实恶劣天气视频数据稀缺。现有天气生成方法难以兼顾视觉质量与标注可复用性。本文提出AutoAWG,一种面向自动驾驶的可控恶劣天气视频生成框架。方法通过语义引导的多控件自适应融合,在强化天气风格的同时保持安全关键目标的高保真;采用视点锚定的时序合成策略,从静态图像构建训练序列,降低对合成数据的依赖;并引入掩码训练以增强长时生成稳定性。在nuScenes验证集上,AutoAWG显著优于现有最先进方法:无首帧条件时,FID和FVD分别降低50.0%和16.1%;有首帧条件时,进一步降低8.7%和7.2%。大量定性和定量结果表明其在风格保真度、时序一致性及语义-结构完整性方面具优势,凸显其在提升下游感知任务中的实用价值。代码已开源。
原文摘要 · Abstract (English)
Perception robustness under adverse weather remains a critical challenge for autonomous driving, with the core bottleneck being the scarcity of real-world video data in adverse weather. Existing weather generation approaches struggle to balance visual quality and annotation reusability. We present AutoAWG, a controllable Adverse Weather video Generation framework for Autonomous driving. Our method employs a semantics-guided adaptive fusion of multiple controls to balance strong weather stylization with high-fidelity preservation of safety-critical targets; leverages a vanishing point-anchored temporal synthesis strategy to construct training sequences from static images, thereby reducing reliance on synthetic data; and adopts masked training to enhance long-horizon generation stability. On the nuScenes validation set, AutoAWG significantly outperforms prior state-of-the-art methods: without first-frame conditioning, FID and FVD are relatively reduced by 50.0% and 16.1%; with first-frame conditioning, they are further reduced by 8.7% and 7.2%, respectively. Extensive qualitative and quantitative results demonstrate advantages in style fidelity, temporal consistency, and semantic--structural integrity, underscoring the practical value of AutoAWG for improving downstream perception in autonomous driving. Our code is available at: https://github.com/higherhu/AutoAWG
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。