首个可应对无人机任意姿态与视角的单目深度估计算法
DAPM: UAV Monocular Depth Estimation from Any Height, Pitch, Roll and FOV

- 基于地面参考建立视角与视距的几何关系,实现密集姿态监督
- 提出粗到精分层量化模块,在复杂空拍场景中提升深度精度
- 适用于真实无人机多变飞行姿态,尤其适合动态导航任务
单目深度估计是无人机3D重建与自主导航的基础。实际应用中,无人机相机姿态持续变化,涉及高度、俯仰角、翻滚角和视场角的大幅波动。现有方法难以泛化至多样化视角及空中场景中的广阔深度分布。为此,我们通过理论分析建立无人机视角的量化表征,以地面为参照推导视角与视距的几何对应关系。在此基础上,提出专为无人机航拍设计的深度估计算法DAPM,首次实现连续变化视角下相机姿态与深度的联合估计。引入理想地面深度(IGD)模块,利用推导出的几何关系实现密集姿态监督并增强深度特征;进一步设计粗到精的分层量化箱(PQB)模块,通过渐进式监督与层级量化提升复杂空拍图像的估计鲁棒性。为评估该框架,我们构建了覆盖完整连续姿态参数分布的UAV Any Perspectives Depth(UAPD)数据集。在该数据集上的实验表明,DAPM在深度与相机姿态估计指标上均达到当前最优表现。
原文摘要 · Abstract (English)
Monocular depth estimation is a fundamental prerequisite for 3D reconstruction and autonomous navigation in Unmanned Aerial Vehicles (UAVs). In practical deployments, UAVs operate under highly dynamic camera poses characterized by continuous variations in height, pitch, roll, and field of view (FOV). Existing monocular depth estimation methods frequently fail to generalize across such diverse perspectives and the expansive scale of depth distributions inherent in aerial scenes. To address these challenges, we establish a quantitative representation of UAV viewing angles through rigorous theoretical analysis, deriving the geometric correspondence between viewing angles and view distances using the ground plane as a reference for observation. Building upon this, we propose Depth Estimation for Any Perspectives Model (DAPM), representing the first monocular framework specifically designed for UAV aerial imagery to jointly estimate camera pose and depth under continuously varying viewpoints. Specifically, we introduce an Ideal Ground Depth (IGD) module that leverages the derived geometric relationships between UAV perspectives and view distances to implement dense camera-pose supervision and enhance depth features. And we further develop a coarse-to-fine Progressive Quantization Bins (PQB) module. By incorporating progressive supervision and hierarchical quantization bins, the PQB module enables robust estimation in complex UAV aerial imagery. To evaluate the proposed framework, we present the UAV Any Perspectives Depth (UAPD) dataset, featuring comprehensive and continuous distributions of pose parameters. Experimental results on UAPD demonstrate that DAPM achieves state-of-the-art performance across both depth and camera-pose estimation metrics. The source code and datasets are available at: https://github.com/ThisIsLT/DAPM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。