arXiv:2607.13927cs.CV2026-07

无需成对数据,用扩散模型实现自然天气编辑。

Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data

论文配图:Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data
图 1 · 摘自论文原文
  • 基于潜空间扩散模型,结合循环一致性约束生成天气效果。
  • 生成结果更真实且保持场景结构,提升下游感知任务性能。
  • 可压缩为视频扩散模型,实现时序一致的天气编辑,适合自动驾驶研究者。

自动驾驶系统在多变天气下的可靠感知仍是重大挑战。现有方法通常依赖合成数据增强或基于物理的、任务特定的模型,需成对训练数据,且难以生成逼真天气效果或泛化到域外场景。为此,我们提出Cyclone,一种基于潜空间扩散模型的统一天气编辑框架,引入循环一致性约束并融合图像-文本模型知识,可在无需成对数据的情况下生成多样场景中的多种天气条件。实验表明,该方法生成结果更真实、结构保持更好,并在多个下游驾驶感知任务中带来稳定提升。此外,Cyclone可被蒸馏为视频扩散模型,实现时序一致的天气编辑。

原文摘要 · Abstract (English)

Reliable perception under diverse weather conditions remains a major challenge for autonomous driving systems. A common strategy to improve robustness is either to synthesize adverse weather conditions for training perception models or to apply weather-removal techniques to recover clean inputs. However, existing approaches typically rely on synthetic data augmentation or physics-based, task-specific models that require paired training data and often struggle to generate realistic weather effects or generalize robustly to out-of-domain scenarios. Toward this problem, we present Cyclone, a unified framework for weather editing based on latent diffusion, equipped with cycle-consistent constraints and knowledge from image-text models. Cyclone enables the generation of multiple weather conditions across diverse scenes while eliminating the need for paired data. Experimental results show that our approach produces more realistic, structure-preserving outputs than existing baselines and leads to consistent improvements across several downstream driving perception tasks. Furthermore, we demonstrate that Cyclone can be distilled to a video diffusion model for temporally consistent weather editing.

扩散模型天气编辑自动驾驶无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。