arXiv:2410.09292cs.CV2024-10被引 17

提升手术场景3D重建精度,专用于机器人辅助手术

SurgicalGS: Dynamic 3D Gaussian Splatting for Accurate Robotic-Assisted Surgical Scene Reconstruction

  • 用深度先验和运动掩码初始化高精度点云
  • 引入归一化深度正则化,几何精度显著提升
  • 适合需要精细三维结构的术中导航应用

从内窥镜视频准确重建动态手术场景对机器人辅助手术至关重要。尽管近期3D高斯溅射方法在快速渲染下实现了高质量重建,但其采用的逆深度损失函数会压缩深度变化,导致细节丢失,难以捕捉精确几何结构,限制了术中应用效果。为此,我们提出SurgicalGS,一种专为手术场景重建设计的动态3D高斯溅射框架,提升了几何精度。首先利用深度先验初始化高斯点云,通过二值运动掩码识别深度显著变化的像素,并融合多帧深度图生成初始点云。采用灵活形变模型表示动态场景,引入归一化深度正则化损失与无监督深度平滑约束,以保障更精确的几何重建。在两个真实手术数据集上的大量实验表明,SurgicalGS在几何精度方面达到当前最优水平,推动了3D高斯溅射在机器人辅助手术中的实用化进程。

原文摘要 · Abstract (English)

Accurate 3D reconstruction of dynamic surgical scenes from endoscopic video is essential for robotic-assisted surgery. While recent 3D Gaussian Splatting methods have shown promise in achieving high-quality reconstructions with fast rendering speeds, their use of inverse depth loss functions compresses depth variations. This can lead to a loss of fine geometric details, limiting their ability to capture precise 3D geometry and effectiveness in intraoperative application. To address these challenges, we present SurgicalGS, a dynamic 3D Gaussian Splatting framework specifically designed for surgical scene reconstruction with improved geometric accuracy. Our approach first initialises a Gaussian point cloud using depth priors, employing binary motion masks to identify pixels with significant depth variations and fusing point clouds from depth maps across frames for initialisation. We use the Flexible Deformation Model to represent dynamic scene and introduce a normalised depth regularisation loss along with an unsupervised depth smoothness constraint to ensure more accurate geometric reconstruction. Extensive experiments on two real surgical datasets demonstrate that SurgicalGS achieves state-of-the-art reconstruction quality, especially in terms of accurate geometry, advancing the usability of 3D Gaussian Splatting in robotic-assisted surgery.

3D重建手术导航高斯溅射动态场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。