arXiv:2505.12199cs.CVcs.AI2025-05IJCAI被引 5

提出ACDepth,提升恶劣天气下单目深度估计精度。

Always Clear Depth: Robust Monocular Depth Estimation under Adverse Weather

  • 用扩散模型生成多类恶劣天气数据,构建鲁棒训练集。
  • 在nuScenes上夜景和雨天的absRel指标分别提升2.50%和2.61%。
  • 适合自动驾驶与复杂环境感知任务的开发者参考。

单目深度估计对自动驾驶和场景重建至关重要。现有方法在正常条件下表现良好,但在恶劣天气下因域偏移和场景信息提取困难而性能下降。为此,本文从高质量训练数据生成与域适应角度出发,提出稳健的单目深度估计方法ACDepth。具体而言,引入一步式扩散模型生成模拟恶劣天气的样本,训练时构建多粒度退化数据集;为保证生成样本质量,采用LoRA适配器微调扩散模型生成权重;同时结合循环一致性损失与对抗训练,确保场景内容的真实自然。此外,设计多粒度知识蒸馏策略(MKD),引导学生网络从教师模型和预训练Depth Anything V2中学习抗退化场景信息,并引入序数指导蒸馏机制(OGD),通过差异排序聚焦不确定区域,提升深度估计精度。实验表明,在nuScenes数据集上,ACDepth在夜景和雨天场景下的absRel指标分别优于md4all-DD 2.50%和2.61%。

原文摘要 · Abstract (English)

Monocular depth estimation is critical for applications such as autonomous driving and scene reconstruction. While existing methods perform well under normal scenarios, their performance declines in adverse weather, due to challenging domain shifts and difficulties in extracting scene information. To address this issue, we present a robust monocular depth estimation method called \textbf{ACDepth} from the perspective of high-quality training data generation and domain adaptation. Specifically, we introduce a one-step diffusion model for generating samples that simulate adverse weather conditions, constructing a multi-tuple degradation dataset during training. To ensure the quality of the generated degradation samples, we employ LoRA adapters to fine-tune the generation weights of diffusion model. Additionally, we integrate circular consistency loss and adversarial training to guarantee the fidelity and naturalness of the scene contents. Furthermore, we elaborate on a multi-granularity knowledge distillation strategy (MKD) that encourages the student network to absorb knowledge from both the teacher model and pretrained Depth Anything V2. This strategy guides the student model in learning degradation-agnostic scene information from various degradation inputs. In particular, we introduce an ordinal guidance distillation mechanism (OGD) that encourages the network to focus on uncertain regions through differential ranking, leading to a more precise depth estimation. Experimental results demonstrate that our ACDepth surpasses md4all-DD by 2.50\% for night scene and 2.61\% for rainy scene on the nuScenes dataset in terms of the absRel metric.

深度估计恶劣天气扩散模型知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。