用稀疏卫星激光数据提升单目高度估计精度,低成本实现全球部署。
Enhancing Monocular Height Estimation via Sparse LiDAR-Guided Correction
- 结合公开的ICESat-2激光数据与深度学习预测,自动修正高度图
- 在6个区域测试中,误差降低30.9%,高程评估分数提升44.2%
- 无需复杂设备,仅需一张地理配准影像即可运行,适合大范围应用
从超高清光学影像进行单目高度估计(MHE)仍面临结构线索不足和传统高程数据成本高、覆盖受限的挑战。尽管近期的MHE和单目深度估计(MDE)模型表现良好,但在不同光照与场景下仍缺乏鲁棒性。本文提出一种全自动校正流程,将稀疏的全球性ICESat-2激光测量与深度学习预测融合,显著提升精度与稳定性。该流程仅依赖公开模型与数据,仅需一张地理配准的光学图像即可生成校正后高程图,支持低成本、全球可扩展部署。我们建立了首个该任务基准,评估了两种随机森林方法、四种参数高效微调策略及全量微调。在六处多样化区域(0.5米分辨率,共297平方公里)测试中,包括东京、巴黎、圣保罗的城市核心区以及郊区和林地,最佳方法使MHE模型的平均绝对误差(MAE)降低30.9%,F1HE得分提升44.2%;MDE模型的MAE下降24.1%,F1HE提升25.1%。结果验证了校正流程的有效性,证明稀疏全球激光数据可系统性增强MHE与MDE模型,推动可扩展、广泛可及的三维高程制图。
原文摘要 · Abstract (English)
Monocular height estimation (MHE) from very-high-resolution (VHR) optical imagery remains challenging due to limited structural cues and the high cost and geographic constraints of conventional elevation data such as airborne LiDAR and multi-view stereo. Although recent MHE and monocular depth estimation (MDE) models show strong performance, their robustness under varied illumination and scene conditions is still limited. We introduce a fully automated correction pipeline that integrates sparse, imperfect global LiDAR measurements from ICESat-2 with deep learning predictions to enhance accuracy and stability. The workflow relies entirely on publicly available models and data and requires only a single georeferenced optical image to produce corrected height maps, enabling low-cost and globally scalable deployment. We also establish the first benchmark for this task, evaluating two random forest based approaches, four parameter efficient fine tuning methods, and full fine tuning. Experiments across six diverse regions at 0.5 m resolution (297 km2), covering the urban cores of Tokyo, Paris, and Sao Paulo as well as suburban and forested areas, show substantial gains. The best method reduces the MHE model's mean absolute error (MAE) by 30.9 percent and improves its F1HE score by 44.2 percent. For the MDE model, MAE improves by 24.1 percent and the F1HE score by 25.1 percent. These results validate the effectiveness of our correction pipeline and demonstrate how sparse global LiDAR can systematically strengthen both MHE and MDE models, enabling scalable and widely accessible 3D height mapping.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。