用扩散模型修复火星地形缺失数据,提升虚拟现实中的真实感。
Inpainting the Red Planet: Diffusion Models for the Reconstruction of Martian Environments in Virtual Reality
- 采用无条件扩散模型,跨尺度捕捉火星地形特征。
- 重建精度比传统方法高4%-15%(RMSE),感知相似度提升29%-81%(LPIPS)。
- 适合行星科学、虚拟现实训练及航天任务规划领域使用。
太空探索越来越多地依赖虚拟现实进行任务规划、多学科科学分析和宇航员训练。模拟的可靠性关键在于行星地形的精确3D表示。从卫星图像获取的外星高程图常因采集和传输限制存在缺失值。火星是地球外研究最深入的行星之一,其广泛的地形数据集使火星表面重建成为有价值的任务,但许多区域仍未测绘。深度学习算法可辅助填补空缺,然而由于地球数据集完备性,现有条件化方法无法适用于火星。当前方法依赖简单插值技术,但常无法保持几何一致性。本文提出一种基于无条件扩散模型的火星表面重建方法。训练使用了由NASA HiRISE调查生成的12000张火星高程图增强数据集。通过非均匀缩放策略,在缩放到固定128x128模型分辨率前捕捉多尺度地形特征。在1000个样本的评估集上,与逆距离加权、克里金法和纳维-斯托克斯算法等经典空洞填充与修复方法对比,结果表明本方法在重建准确率(RMSE降低4%-15%)和感知相似度(LPIPS降低29%-81%)方面均持续领先。
原文摘要 · Abstract (English)
Space exploration increasingly relies on Virtual Reality for several tasks, such as mission planning, multidisciplinary scientific analysis, and astronaut training. A key factor for the reliability of the simulations is having accurate 3D representations of planetary terrains. Extraterrestrial heightmaps derived from satellite imagery often contain missing values due to acquisition and transmission constraints. Mars is among the most studied planets beyond Earth, and its extensive terrain datasets make the Martian surface reconstruction a valuable task, although many areas remain unmapped. Deep learning algorithms can support void-filling tasks; however, whereas Earth's comprehensive datasets enables the use of conditional methods, such approaches cannot be applied to Mars. Current approaches rely on simpler interpolation techniques which, however, often fail to preserve geometric coherence. In this work, we propose a method for reconstructing the surface of Mars based on an unconditional diffusion model. Training was conducted on an augmented dataset of 12000 Martian heightmaps derived from NASA's HiRISE survey. A non-homogeneous rescaling strategy captures terrain features across multiple scales before resizing to a fixed 128x128 model resolution. We compared our method against established void-filling and inpainting techniques, including Inverse Distance Weighting, kriging, and Navier-Stokes algorithm, on an evaluation set of 1000 samples. Results show that our approach consistently outperforms these methods in terms of reconstruction accuracy (4-15% on RMSE) and perceptual similarity (29-81% on LPIPS) with the original data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。