无需天气标签,通过双判别器引导扩散模型恢复恶劣天气下的激光雷达特征。
Open-Weather Robust 3D Detection via Dual-Critic Diffusion Alignment

- 用4D雷达条件扩散过程逐步修复退化特征,不依赖具体天气类型。
- 在未见天气条件下检测精度提升32.1%,显著优于传统方法。
- 适合自动驾驶系统在复杂多变天气中保持鲁棒性,尤其无标注场景。
恶劣天气下的鲁棒3D目标检测仍是自动驾驶的关键挑战。尽管激光雷达与4D雷达融合取得进展,多数方法受限于封闭世界假设,隐含要求训练与测试天气在类型和严重程度上一致。现实中,天气的开放性及同一类型(如雨)内部差异导致激光雷达退化模式剧烈变化,造成未见条件下的性能大幅下降。为此,我们提出双判别器引导的扩散对齐(DCDA)框架,实现无需天气标签的泛化能力。该框架不建模具体天气,而是利用4D雷达条件扩散过程,通过两个互补判别器指导特征逐步恢复至清洁状态:(i) 检测引导判别器基于预训练的晴天模型,确保修复后特征具备物体级可区分性与定位精度;(ii) 天气对抗判别器强制与晴天表示的整体分布一致性。通过语义与分布双重约束对齐特征,而非显式建模天气,使模型有效泛化至未见天气类型与严重程度,且无需成对数据或天气标签。我们进一步构建了一个结构化的开放天气基准,包含保留的类型-严重度组合,并通过大量实验验证了DCDA的优势。
原文摘要 · Abstract (English)
Robust 3D object detection under adverse weather remains a critical hurdle for autonomous driving. Despite progress with LiDAR-4D radar fusion, most methods are constrained by a closed-world assumption, implicitly requiring training and test weather to align in both type and severity. This premise fails in practice: the open-ended nature of weather, and even variations within a single type like rain, cause dramatically different LiDAR degradation patterns, leading to significant performance drops in unseen conditions. To address this, we present Dual-Critic Guided Diffusion Alignment (DCDA), a weather-agnostic framework that learns to recover degraded LiDAR features toward a clean manifold. Rather than modeling specific weather types, DCDA employs a 4D radar-conditioned diffusion process to progressively refine features, guided by two complementary critics. (i) A detection-guided critic, anchored by a pre-trained clean-weather model, ensures that the refined features retain object-level discriminability and localization accuracy. (ii) A weather adversarial critic enforces holistic distributional consistency with clean-weather representations. By aligning features through semantic and distributional constraints rather than explicit weather modeling, DCDA generalizes effectively to unseen weather types and severities without requiring paired data or weather labels. We further introduce a structured open-weather benchmark with held-out type-severity combinations and extensive experiments verify DCDA's advantages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。