arXiv:2601.06909cs.CV2026-01被引 3

利用深度先验提升去雾模型鲁棒性,显著改善真实场景下的去雾效果。

UDPNet: Unleashing Depth-based Priors for Robust Image Dehazing

  • 引入深度先验信息,通过注意力机制融合多尺度深度特征。
  • 在SOTS-indoor、Haze4K和NHR数据集上分别提升0.85、1.19、1.79 dB PSNR。
  • 适用于复杂光照与真实世界数据,适合需要高鲁棒性的图像增强场景。

图像去雾得益于深度学习的发展取得显著进展。然而,大多数方法仅依赖单模态RGB特征,忽视了场景深度与雾霾分布之间的内在关联。即使一些联合优化深度估计与去雾的方法,也因未能有效利用精确深度信息而导致性能不佳。本文提出UDPNet,一个通用框架,利用大规模预训练深度估计模型DepthAnything V2提供的深度先验,增强现有去雾模型。其核心包含两个模块:深度引导注意力模块(DGAM)通过轻量级深度引导通道注意力自适应调制特征;深度先验融合模块(DPFM)采用双滑动窗口多头交叉注意力机制实现多尺度深度图特征的分层融合。该设计兼顾计算效率与深度先验的有效整合。此外,深度先验使网络能动态适应不同雾霾密度、光照条件及合成与真实数据间的域差异。大量实验表明,UDPNet在主流去雾数据集上优于现有最先进方法,其中在SOTS-indoor、Haze4K和NHR上的PSNR分别提升0.85 dB、1.19 dB和1.79 dB。本方案为多种场景下的深度感知去雾建立了新基准。预训练模型与代码已开源至https://github.com/Harbinzzy/UDPNet。

原文摘要 · Abstract (English)

Image dehazing has witnessed significant advancements with the development of deep learning models. However, most existing methods focus solely on single-modal RGB features, neglecting the inherent correlation between scene depth and haze distribution. Even those that jointly optimize depth estimation and image dehazing often suffer from suboptimal performance due to inadequate utilization of accurate depth information. In this paper, we present UDPNet, a general framework that leverages depth-based priors from a large-scale pretrained depth estimation model DepthAnything V2 to boost existing image dehazing models. Specifically, our architecture comprises two key components: the Depth-Guided Attention Module (DGAM) adaptively modulates features via lightweight depth-guided channel attention, and the Depth Prior Fusion Module (DPFM) enables hierarchical fusion of multi-scale depth map features by dual sliding-window multi-head cross-attention mechanism. These modules ensure both computational efficiency and effective integration of depth priors. Moreover, the depth priors empower the network to dynamically adapt to varying haze densities, illumination conditions, and domain gaps across synthetic and real-world data. Extensive experimental results demonstrate the effectiveness of our UDPNet, outperforming the state-of-the-art methods on popular dehazing datasets, with PSNR improvements of 0.85 dB on SOTS-indoor, 1.19 dB on Haze4K, and 1.79 dB on NHR. Our proposed solution establishes a new benchmark for depth-aware dehazing across various scenarios. Pretrained models and codes are released at our project https://github.com/Harbinzzy/UDPNet.

图像去雾深度先验注意力机制多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。