用表面法向感知提升内窥镜重建精度,实现高保真实时三维重建。
Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mapping
- 融合点到点与点到面距离的跟踪模块,提升定位准确性。
- 深度重建均方根误差达1.87±0.63毫米,优于现有方法。
- 适合需要高精度三维重建的微创手术导航与机器人系统。
同步定位与地图构建(SLAM)在微创手术和机器人任务中至关重要。尽管3D高斯点阵(3DGS)提升了新视角合成质量与渲染速度,但其多视角不一致问题导致深度与表面重建不准。本文提出端到端2D高斯点阵(2DGS)驱动的实时内窥镜SLAM系统Endo-2DTAM,引入表面法向感知的追踪与建图流程。其鲁棒跟踪模块结合点到点与点到面距离度量;映射模块利用法向一致性与深度畸变优化表面重建。同时设计姿态一致的关键帧采样策略,确保几何连贯性。在多个公开内窥镜数据集上验证表明,该系统在保持高效追踪与高质量视觉呈现的同时,实现1.87±0.63毫米的深度重建均方根误差,支持实时渲染。代码将开源。
原文摘要 · Abstract (English)
Simultaneous Localization and Mapping (SLAM) is essential for precise surgical interventions and robotic tasks in minimally invasive procedures. While recent advancements in 3D Gaussian Splatting (3DGS) have improved SLAM with high-quality novel view synthesis and fast rendering, these systems struggle with accurate depth and surface reconstruction due to multi-view inconsistencies. Simply incorporating SLAM and 3DGS leads to mismatches between the reconstructed frames. In this work, we present Endo-2DTAM, a real-time endoscopic SLAM system with 2D Gaussian Splatting (2DGS) to address these challenges. Endo-2DTAM incorporates a surface normal-aware pipeline, which consists of tracking, mapping, and bundle adjustment modules for geometrically accurate reconstruction. Our robust tracking module combines point-to-point and point-to-plane distance metrics, while the mapping module utilizes normal consistency and depth distortion to enhance surface reconstruction quality. We also introduce a pose-consistent strategy for efficient and geometrically coherent keyframe sampling. Extensive experiments on public endoscopic datasets demonstrate that Endo-2DTAM achieves an RMSE of $1.87\pm 0.63$ mm for depth reconstruction of surgical scenes while maintaining computationally efficient tracking, high-quality visual appearance, and real-time rendering. Our code will be released at github.com/lastbasket/Endo-2DTAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。