arXiv:2501.01101cs.CV2025-01ICRA被引 7

提出新方法实现手术场景高效高保真动态重建

Deformable Gaussian Splatting for Efficient and High-Fidelity Reconstruction of Surgical Scenes

  • 引入3D高斯生命周期建模,捕捉可逆与不可逆形变
  • 构建自适应运动层次结构,减少计算量提升渲染速度
  • 适合医学影像重建、实时手术可视化研究者使用

高效且高保真的可变形手术场景重建是一项关键但极具挑战性的任务。基于近期3D高斯点阵技术的进展,现有方法在重建质量与渲染速度方面已显著提升。然而仍存在两大局限:(1) 难以处理组织剪切等不可逆动态变化,这在手术场景中常见;(2) 缺乏对手术场景形变的分层建模,导致渲染效率受限。为此,我们提出EH-SurGS,一种面向可变形手术场景的高效高保真重建算法。我们设计了一种结合3D高斯生命周期的形变建模方法,有效捕捉常规与不可逆形变,从而提升重建质量;同时提出自适应运动层次策略,区分场景中的静态与可变形区域,减少通过形变场的3D高斯数量,进而提高渲染速度。大量实验表明,本方法在重建质量与渲染速度上均优于现有最先进方法。消融实验进一步验证了所提组件的有效性与必要性。论文被接收后将开源代码。

原文摘要 · Abstract (English)

Efficient and high-fidelity reconstruction of deformable surgical scenes is a critical yet challenging task. Building on recent advancements in 3D Gaussian splatting, current methods have seen significant improvements in both reconstruction quality and rendering speed. However, two major limitations remain: (1) difficulty in handling irreversible dynamic changes, such as tissue shearing, which are common in surgical scenes; and (2) the lack of hierarchical modeling for surgical scene deformation, which reduces rendering speed. To address these challenges, we introduce EH-SurGS, an efficient and high-fidelity reconstruction algorithm for deformable surgical scenes. We propose a deformation modeling approach that incorporates the life cycle of 3D Gaussians, effectively capturing both regular and irreversible deformations, thus enhancing reconstruction quality. Additionally, we present an adaptive motion hierarchy strategy that distinguishes between static and deformable regions within the surgical scene. This strategy reduces the number of 3D Gaussians passing through the deformation field, thereby improving rendering speed. Extensive experiments demonstrate that our method surpasses existing state-of-the-art approaches in both reconstruction quality and rendering speed. Ablation studies further validate the effectiveness and necessity of our proposed components. We will open-source our code upon acceptance of the paper.

三维重建手术可视化高斯点阵动态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。