arXiv:2505.14159cs.CVcs.RO2025-05被引 2

用小波增强深度估计,提升火星地形导航精度

M3Depth: Wavelet-Enhanced Depth Estimation on Mars via Mutual Boosting of Dual-Modal Data

  • 引入小波卷积核捕捉火星低频纹理特征
  • 通过法向量一致性损失提升深度估计准确率16%
  • 双模态互增强机制适合复杂火星地形应用

深度估计在未来的火星探测任务中对避障和导航具有重要意义。相较于传统立体匹配,基于学习的立体深度估计可通过图像对生成稠密精确的深度图。然而,在纹理稀疏、几何约束弱的环境(如火星无结构地形)中,现有方法性能下降明显。为此,我们提出专为火星漫游车设计的M3Depth模型。考虑到火星地表以低频特征为主,纹理稀疏平滑,模型引入基于小波变换的卷积核,有效捕获低频响应并扩展感受野。此外,设计了一种显式建模深度图与表面法向量互补关系的一致性损失,利用法向量作为几何约束增强深度估计精度。同时,提出像素级精修模块,通过双模态互增强机制迭代优化深度与法向量预测。在带有深度标注的合成火星数据集上实验表明,M3Depth相比其他先进方法深度估计准确率提升16%。此外,该模型在真实火星场景中也表现出强适用性,为未来火星探索任务提供了有前景的解决方案。

原文摘要 · Abstract (English)

Depth estimation plays a great potential role in obstacle avoidance and navigation for further Mars exploration missions. Compared to traditional stereo matching, learning-based stereo depth estimation provides a data-driven approach to infer dense and precise depth maps from stereo image pairs. However, these methods always suffer performance degradation in environments with sparse textures and lacking geometric constraints, such as the unstructured terrain of Mars. To address these challenges, we propose M3Depth, a depth estimation model tailored for Mars rovers. Considering the sparse and smooth texture of Martian terrain, which is primarily composed of low-frequency features, our model incorporates a convolutional kernel based on wavelet transform that effectively captures low-frequency response and expands the receptive field. Additionally, we introduce a consistency loss that explicitly models the complementary relationship between depth map and surface normal map, utilizing the surface normal as a geometric constraint to enhance the accuracy of depth estimation. Besides, a pixel-wise refinement module with mutual boosting mechanism is designed to iteratively refine both depth and surface normal predictions. Experimental results on synthetic Mars datasets with depth annotations show that M3Depth achieves a 16% improvement in depth estimation accuracy compared to other state-of-the-art methods in depth estimation. Furthermore, the model demonstrates strong applicability in real-world Martian scenarios, offering a promising solution for future Mars exploration missions.

深度估计火星探测小波变换多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。