基于坡度感知的遥感地形重建方法,提升大范围地表高程估计精度。
TS-SatMVSNet: Slope Aware Height Estimation for Large-Scale Earth Terrain Multi-view Stereo
- 引入坡度信息,通过高度图计算坡度图,指导三维重建。
- 设计微宏观双级坡度引导模块,分别优化局部精细高度和整体平滑性。
- 在WHU-TLC和MVS3D数据集上达到当前最佳性能,适合大规模地形监测应用。
利用遥感影像进行3D地形重建具有成本低、覆盖范围广的优点,对自然灾害防护、生态变化监测和环境保护至关重要。近年来,基于学习的多视角立体(MVS)方法在此任务中展现出潜力。然而,现有方法仅简单调整通用学习型MVS框架用于高程估计,忽视了地形特征,导致精度不足。考虑到地球表面通常起伏平缓且可通过坡度衡量,将坡度信息融入MVS框架可提升重建准确性。为此,本文提出一种端到端的坡度感知高程估计网络TS-SatMVSNet,用于大规模遥感地形重建。为有效获取坡度表示,借鉴数学梯度思想,创新提出基于高度图的坡度计算策略,先生成坡度图以量化地形起伏。为充分融合坡度信息,分别设计两个坡度引导模块,分别在微观与宏观层面增强重建效果:微观层面,设计坡度引导区间划分模块,利用坡度值实现精细化高程估计;宏观层面,提出高度修正模块,采用可学习的高斯平滑算子修正不准确的高程值。此外,为提升高程估计效能,提出坡度方向损失,隐式优化高程结果。在WHU-TLC与MVS3D数据集上的大量实验表明,所提方法达到当前最优性能,并展现出良好的泛化能力。
原文摘要 · Abstract (English)
3D terrain reconstruction with remote sensing imagery achieves cost-effective and large-scale earth observation and is crucial for safeguarding natural disasters, monitoring ecological changes, and preserving the environment.Recently, learning-based multi-view stereo~(MVS) methods have shown promise in this task. However, these methods simply modify the general learning-based MVS framework for height estimation, which overlooks the terrain characteristics and results in insufficient accuracy. Considering that the Earth's surface generally undulates with no drastic changes and can be measured by slope, integrating slope considerations into MVS frameworks could enhance the accuracy of terrain reconstructions. To this end, we propose an end-to-end slope-aware height estimation network named TS-SatMVSNet for large-scale remote sensing terrain reconstruction.To effectively obtain the slope representation, drawing from mathematical gradient concepts, we innovatively proposed a height-based slope calculation strategy to first calculate a slope map from a height map to measure the terrain undulation. To fully integrate slope information into the MVS pipeline, we separately design two slope-guided modules to enhance reconstruction outcomes at both micro and macro levels. Specifically, at the micro level, we designed a slope-guided interval partition module for refined height estimation using slope values. At the macro level, a height correction module is proposed, using a learnable Gaussian smoothing operator to amend the inaccurate height values. Additionally, to enhance the efficacy of height estimation, we proposed a slope direction loss for implicitly optimizing height estimation results. Extensive experiments on the WHU-TLC dataset and MVS3D dataset show that our proposed method achieves state-of-the-art performance and demonstrates competitive generalization ability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。