针对无人机图像去雾难题,提出新物理模型与几何感知网络,显著提升远距离细节恢复能力。
Towards UAV Image Dehazing: A UAV Atmospheric Scattering Model, Benchmark, and Geometry-Aware Deep Unfolding Network

- 构建无人机专用大气散射模型(UASM),融合飞行高度、视角等参数建模非均匀雾霾分布。
- 提出几何感知深度展开网络(GP-DUN),在合成与真实数据上均超越现有方法。
- 开源含2285张真实无人机雾图的数据集,支持可控合成与基准测试,适合遥感与低空视觉研究者。
在无人机应用中,雾霾严重模糊远距离细节并削弱结构信息,阻碍细节恢复。当前面临两大挑战:(i) 真实世界中难以获取成对的有雾/清晰图像,且经典大气散射模型无法准确描述无人机影像中的空间非均匀雾霾;(ii) 现有去雾方法难以去除图像上部积累的厚重雾霾。为此,我们首先提出无人机大气散射模型(UASM),显式引入飞行高度、观测俯仰角和消光系数,刻画无人机成像中的非均匀雾霾分布。基于UASM,构建物理驱动的去雾框架——几何感知近端深度展开网络(GP-DUN)。该网络包含三个关键模块:潜空间几何估计器(LGE)推断符合无人机成像几何的透射率;几何感知梯度下降模块(GeoGDM)将UASM嵌入数据保真项,并执行物理一致的闭式更新;池化专家近端映射模块(PE-PMM)学习隐式先验,恢复超出显式物理建模能力的纹理与结构。此外,我们进一步构建了UASM-HazeSet,提供可控合成成对数据及2,285张真实无人机雾图用于测试。大量实验表明,GP-DUN在UASM-HazeSet与真实无人机雾图基准上均持续优于现有方法。
原文摘要 · Abstract (English)
In UAV applications, haze significantly obscures distant details and weaken structural information, hindering the recovery of details. Current UAV scenarios still face two key challenges: (i) paired hazy/clean images from the real world are unobtainable, while the classical atmospheric scattering model is inadequate for modeling the spatially non-uniform haze in UAV imagery; (ii) existing dehazing methods struggle to remove the heavy haze accumulated in the upper regions of UAV images. To address these issues, we first propose a UAV Atmospheric Scattering Model (UASM), which explicitly incorporates flight altitude, viewing pitch, and extinction to characterize the non-uniform haze distribution in UAV imaging. Based on UASM, we develop a physics-driven dehazing framework, termed Geometry-aware Proximal Deep Unfolding Network (GP-DUN). Specifically, GP-DUN consists of three key modules: a Latent Geometry Estimator (LGE) that infers transmittance consistent with UAV imaging geometry, a Geometry-aware Gradient Descent Module (GeoGDM) that embeds UASM into the data-fidelity term and performs physics-consistent closed-form updates, and an Pooling-Expert Proximal Mapping Module (PE-PMM) that learns an implicit prior to restore textures and structures beyond the capability of explicit physical modeling. In addition, we further construct UASM-HazeSet, which provides controllable paired synthetic data together with 2,285 real UAV haze images for testing. Extensive experiments show that GP-DUN consistently outperforms existing methods on both UASM-HazeSet and real UAV haze benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。