arXiv:2603.14701cs.CV2026-03被引 1

解决恶劣天气下深度补全难题,提出首个大规模多天气基准与统一重建方法。

AURORA-KITTI: Any-Weather Depth Completion and Denoising in the Wild

  • 将深度补全与去噪融合为统一任务,用稀疏输入重建稠密深度图并抑制噪声。
  • 在8.2万组多天气图像-激光雷达对上实现当前最佳性能,夜间和严重雾霾场景表现突出。
  • 适合关注真实场景鲁棒性、自动驾驶感知的科研与工程人员。

鲁棒的深度补全对真实世界三维场景理解至关重要,但现有RGB-LiDAR融合方法在恶劣天气下性能显著下降,因相机图像和激光雷达测量均受天气干扰。本文提出AURORA-KITTI,首个大规模多模态、多天气的真实环境深度补全基准。我们进一步将深度补全与去噪(DCD)统一为一项任务:从受损稀疏输入中联合重建稠密深度图并抑制天气引起的噪声。AURORA-KITTI包含超过82,000组天气一致的RGB-LiDAR配对数据,带有真实深度真值,覆盖多种天气类型、三个严重等级、昼夜场景、配对干净参考图、镜头遮挡条件及文本描述。此外,我们提出DDCD,一种基于知识蒸馏的高效基线,利用深度基础模型注入清洁结构先验,用于野外DCD训练。DDCD在AURORA-KITTI和真实世界DENSE数据集上均达到当前最优效果,同时保持高效。结果表明,天气感知且物理一致的数据对鲁棒性提升作用大于架构改进本身。数据与代码将在发表后公开。

原文摘要 · Abstract (English)

Robust depth completion is fundamental to real-world 3D scene understanding, yet existing RGB-LiDAR fusion methods degrade significantly under adverse weather, where both camera images and LiDAR measurements suffer from weather-induced corruption. In this paper, we introduce AURORA-KITTI, the first large-scale multi-modal, multi-weather benchmark for robust depth completion in the wild. We further formulate Depth Completion and Denoising (DCD) as a unified task that jointly reconstructs a dense depth map from corrupted sparse inputs while suppressing weather-induced noise. AURORA-KITTI contains over \textit{82K} weather-consistent RGBL pairs with metric depth ground truth, spanning diverse weather types, three severity levels, day and night scenes, paired clean references, lens occlusion conditions, and textual descriptions. Moreover, we introduce DDCD, an efficient distillation-based baseline that leverages depth foundation models to inject clean structural priors into in-the-wild DCD training. DDCD achieves state-of-the-art performance on AURORA-KITTI and the real-world DENSE dataset while maintaining efficiency. Notably, our results further show that weather-aware, physically consistent data contributes more to robustness than architectural modifications alone. Data and code will be released upon publication.

深度补全多模态恶劣天气基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。