arXiv:2602.18314cs.CVcs.GR2026-02被引 2

用扩散模型修复手术遮挡,结合2D高斯泼溅实现高精度实时重建。

Diff2DGS: Reliable Reconstruction of Occluded Surgical Scenes via 2D Gaussian Splatting

  • 先用扩散模型基于时间信息修复被器械遮挡的组织
  • 通过可学习形变模型提升动态组织重建精度,深度误差更低
  • 在真实手术数据集上验证几何准确性,适合机器人手术导航

实时重建可变形手术场景对推进机器人手术、改善术中引导和实现自动化至关重要。现有方法虽能从达芬奇手术视频中实现稠密重建,但高斯泼溅(GS)在遮挡区域的重建质量仍有限,且深度精度缺乏充分评估,因现有基准如EndoNeRF和StereoMIS缺少三维真值。本文提出Diff2DGS,一种两阶段框架,用于可靠重建遮挡的手术场景:首先,基于扩散的视频模块结合时间先验,以高时空一致性填补被器械遮挡的组织;其次,将2D高斯泼溅(2DGS)与可学习形变模型(LDM)结合,捕捉动态组织形变与解剖结构,并引入自适应深度权重提升几何保真度。我们还扩展了评估范围,在SCARED数据集上进行定量深度分析。Diff2DGS在外观和几何上均优于当前最佳方法,在EndoNeRF上达到38.02 dB PSNR,StereoMIS上为34.40 dB。实验表明,单纯优化图像质量并不保证准确的3D几何。代码已公开于https://diff2dgs.github.io/。

原文摘要 · Abstract (English)

Real-time reconstruction of deformable surgical scenes is vital for advancing robotic surgery, improving intraoperative guidance, and enabling automation. Recent methods achieve dense reconstructions from da Vinci robotic surgery videos, with Gaussian Splatting (GS) offering real-time performance via graphics acceleration. However, reconstruction quality in occluded regions remains limited, and depth accuracy has not been fully assessed, as benchmarks like EndoNeRF and StereoMIS lack 3D ground truth. We propose Diff2DGS, a two-stage framework for reliable 3D reconstruction of occluded surgical scenes. First, a diffusion-based video module with temporal priors inpaints tissue occluded by instruments with high spatiotemporal consistency. Second, we adapt 2D Gaussian Splatting (2DGS) with a Learnable Deformation Model (LDM) to capture dynamic tissue deformation and anatomical geometry, and introduce adaptive depth weight to improve geometric fidelity. We further extend evaluation beyond image-quality metrics by performing quantitative depth analysis on the SCARED dataset. Diff2DGS outperforms state-of-the-art methods in both appearance and geometry, reaching 38.02 dB PSNR on EndoNeRF and 34.40 dB on StereoMIS. Our experiments also show that optimizing image quality alone does not necessarily ensure accurate 3D geometry.The code is available at https://diff2dgs.github.io/.

手术重建2D高斯扩散模型机器人手术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。