用物理真实合成数据提升异常分割性能,解决真实数据稀缺问题。
ClimaOoD: Improving Anomaly Segmentation via Physically Realistic Synthetic Data
- 通过语义引导生成多天气异常图像,保证上下文一致性和物理真实性。
- 在Fishyscapes LAF上,FPR95从3.97降至3.52,模型鲁棒性显著增强。
- 适合自动驾驶中开放世界异常检测研究者使用,尤其关注数据增强方法。
异常分割旨在检测和定位超出预定义语义类的未知或分布外(OoD)物体,对安全自动驾驶至关重要。然而,异常数据稀缺且多样性不足,严重制约模型在开放世界环境中的泛化能力。现有方法通过合成数据缓解此问题,或采用外部物体复制粘贴,或利用文本到图像扩散模型修补异常区域。但这些方法常缺乏上下文连贯性和物理真实性,导致合成与真实数据间存在域差距。本文提出ClimaDrive,一种语义引导的图像到图像框架,用于生成语义一致、天气多样且物理真实的驾驶场景异常数据。ClimaDrive融合结构引导的多天气生成与提示驱动的异常修补,实现视觉逼真的训练数据生成。基于该框架,构建了涵盖六种典型驾驶场景、覆盖晴天与恶劣天气的大规模基准ClimaOoD。在四种前沿方法上的大量实验表明,使用ClimaOoD训练可带来显著性能提升:所有方法在AUROC、AP和FPR95上均有改善,其中RbA在Fishyscapes LAF上FPR95从3.97降至3.52。结果证明,ClimaOoD增强了模型鲁棒性,为开放世界异常检测提供了高质量训练数据。
原文摘要 · Abstract (English)
Anomaly segmentation seeks to detect and localize unknown or out-of-distribution (OoD) objects that fall outside predefined semantic classes a capability essential for safe autonomous driving. However, the scarcity and limited diversity of anomaly data severely constrain model generalization in open-world environments. Existing approaches mitigate this issue through synthetic data generation, either by copy-pasting external objects into driving scenes or by leveraging text-to-image diffusion models to inpaint anomalous regions. While these methods improve anomaly diversity, they often lack contextual coherence and physical realism, resulting in domain gaps between synthetic and real data. In this paper, we present ClimaDrive, a semantics-guided image-to-image framework for synthesizing semantically coherent, weather-diverse, and physically plausible OoD driving data. ClimaDrive unifies structure-guided multi-weather generation with prompt-driven anomaly inpainting, enabling the creation of visually realistic training data. Based on this framework, we construct ClimaOoD, a large-scale benchmark spanning six representative driving scenarios under both clear and adverse weather conditions. Extensive experiments on four state-of-the-art methods show that training with ClimaOoD leads to robust improvements in anomaly segmentation. Across all methods, AUROC, AP, and FPR95 show notable gains, with FPR95 dropping from 3.97 to 3.52 for RbA on Fishyscapes LAF. These results demonstrate that ClimaOoD enhances model robustness, offering valuable training data for better generalization in open-world anomaly detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。