为月球单目深度估计构建真实数据集与评测框架,揭示现有模型在月面环境下的严重泛化不足。
LuMon: A Comprehensive Benchmark and Development Suite with Novel Datasets for Lunar Monocular Depth Estimation
- 基于嫦娥三号真实数据和暗区模拟数据构建新基准
- 发现主流模型在真实月面图像上性能大幅下降
- 揭示从仿真到真实场景的跨域迁移仍存巨大鸿沟
单目深度估计(MDE)对依赖电光相机的自主月球车导航至关重要。然而,将地球上的MDE网络部署至月球会因极端阴影、无纹理月壤及无大气散射而产生严重领域差异。现有评估依赖于无法复现这些条件的类比数据集,且缺乏真实度量真值。为此,我们提出LuMon,一个全面的评测框架,包含来自真实嫦娥三号任务的高质量立体真值深度数据以及CHERI暗区模拟数据集。利用该框架,我们对前沿架构在合成、类比和真实数据集上进行系统性零样本评估,严格测试其在撞击坑、岩石、极端阴影和不同深度范围等任务关键挑战下的表现。此外,通过在合成数据上微调基础模型建立从仿真到真实场景的域适应基线。尽管该适应带来显著的域内性能提升,但在真实月面图像上泛化能力极弱,凸显持续存在的跨域迁移鸿沟。我们的分析揭示了当前网络的根本局限,并为未来外星感知与域适应研究奠定标准基础。
原文摘要 · Abstract (English)
Monocular Depth Estimation (MDE) is crucial for autonomous lunar rover navigation using electro-optical cameras. However, deploying terrestrial MDE networks to the Moon brings a severe domain gap due to harsh shadows, textureless regolith, and zero atmospheric scattering. Existing evaluations rely on analogs that fail to replicate these conditions and lack actual metric ground truth. To address this, we present LuMon, a comprehensive benchmarking framework to evaluate MDE methods for lunar exploration. We introduce novel datasets featuring high-quality stereo ground truth depth from the real Chang'e-3 mission and the CHERI dark analog dataset. Utilizing this framework, we conduct a systematic zero-shot evaluation of state-of-the-art architectures across synthetic, analog, and real datasets. We rigorously assess performance against mission critical challenges like craters, rocks, extreme shading, and varying depth ranges. Furthermore, we establish a sim-to-real domain adaptation baseline by fine tuning a foundation model on synthetic data. While this adaptation yields drastic in-domain performance gains, it exhibits minimal generalization to authentic lunar imagery, highlighting a persistent cross-domain transfer gap. Our extensive analysis reveals the inherent limitations of current networks and sets a standard foundation to guide future advancements in extraterrestrial perception and domain adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。