用3D高斯点绘实现月面实时高精度建图,融合语义分割与深度估计。
Semantic Segmentation and Depth Estimation for Real-Time Lunar Surface Mapping Using 3D Gaussian Splatting
- 基于3D高斯点绘构建实时映射框架,融合语义分割与深度估计模型。
- 120米路径重建几何高度误差约3厘米,优于无LiDAR的点云基线。
- 支持新视角合成与联合优化,适合未来月面探测任务的导航需求。
月面导航与制图需在纹理匮乏、光照对比度高、算力受限等挑战下实现鲁棒感知。本文提出一种结合密集感知模型与3D高斯点绘(3DGS)表示的实时映射框架。我们首先在LuPNT模拟器生成的合成数据集上评估多个模型,选用基于门控循环单元的立体稠密深度估计模型以平衡速度与精度,采用卷积神经网络实现更优的语义分割性能。利用真值位姿解耦局部场景理解与全局状态估计,该流程实现了120米轨迹的重建,几何高度精度约为3厘米,优于无LiDAR的传统点云基线。生成的3DGS地图支持新视角合成,并可作为完整SLAM系统的基础,其联合地图与位姿优化能力具有显著优势。结果表明,将语义分割与稠密深度估计结合学习型地图表示,是构建详细大尺度月面地图的有效方法,可支撑未来月面任务。
原文摘要 · Abstract (English)
Navigation and mapping on the lunar surface require robust perception under challenging conditions, including poorly textured environments, high-contrast lighting, and limited computational resources. This paper presents a real-time mapping framework that integrates dense perception models with a 3D Gaussian Splatting (3DGS) representation. We first benchmark several models on synthetic datasets generated with the LuPNT simulator, selecting a stereo dense depth estimation model based on Gated Recurrent Units for its balance of speed and accuracy in depth estimation, and a convolutional neural network for its superior performance in detecting semantic segments. Using ground truth poses to decouple the local scene understanding from the global state estimation, our pipeline reconstructs a 120-meter traverse with a geometric height accuracy of approximately 3 cm, outperforming a traditional point cloud baseline without LiDAR. The resulting 3DGS map enables novel view synthesis and serves as a foundation for a full SLAM system, where its capacity for joint map and pose optimization would offer significant advantages. Our results demonstrate that combining semantic segmentation and dense depth estimation with learned map representations is an effective approach for creating detailed, large-scale maps to support future lunar surface missions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。