arXiv:2506.23308cs.CV2025-06被引 4

解决内窥镜图像在暗光和过曝下的重建难题,提升手术场景渲染质量。

Endo-4DGX: Robust Endoscopic Scene Reconstruction and Illumination Correction with Gaussian Splatting

  • 引入光照自适应的高斯点阵,建模视角相关的亮度变化。
  • 在暗光与过曝条件下,渲染质量显著优于现有方法。
  • 适合用于机器人辅助手术中的实时三维重建与光照校正。

精准重建软组织对于推进图像引导机器人手术的自动化至关重要。近年来,基于3D高斯点阵(3DGS)及其变体4DGS的方法实现了动态手术场景的高质量实时渲染。然而,在光照变化剧烈(如低光或过曝)的情况下,3D-GS方法仍面临严重优化问题,导致渲染质量急剧下降。为此,本文提出面向内窥镜场景的新型重建方法Endo-4DGX,采用光照自适应的高斯点阵设计,有效建模视图依赖的亮度差异。通过引入区域感知增强模块,以高斯级别建模子区域明暗特征;结合空间感知调整模块,学习视图一致的亮度修正策略。此外,引入曝光控制损失,将极端曝光下的外观恢复至正常水平,支持光照自适应优化。实验表明,Endo-4DGX在复杂光照环境下显著优于当前主流重建与修复方法组合,展现出在机器人辅助手术应用中的巨大潜力。代码已开源:https://github.com/lastbasket/Endo-4DGX。

原文摘要 · Abstract (English)

Accurate reconstruction of soft tissue is crucial for advancing automation in image-guided robotic surgery. The recent 3D Gaussian Splatting (3DGS) techniques and their variants, 4DGS, achieve high-quality renderings of dynamic surgical scenes in real-time. However, 3D-GS-based methods still struggle in scenarios with varying illumination, such as low light and over-exposure. Training 3D-GS in such extreme light conditions leads to severe optimization problems and devastating rendering quality. To address these challenges, we present Endo-4DGX, a novel reconstruction method with illumination-adaptive Gaussian Splatting designed specifically for endoscopic scenes with uneven lighting. By incorporating illumination embeddings, our method effectively models view-dependent brightness variations. We introduce a region-aware enhancement module to model the sub-area lightness at the Gaussian level and a spatial-aware adjustment module to learn the view-consistent brightness adjustment. With the illumination adaptive design, Endo-4DGX achieves superior rendering performance under both low-light and over-exposure conditions while maintaining geometric accuracy. Additionally, we employ an exposure control loss to restore the appearance from adverse exposure to the normal level for illumination-adaptive optimization. Experimental results demonstrate that Endo-4DGX significantly outperforms combinations of state-of-the-art reconstruction and restoration methods in challenging lighting environments, underscoring its potential to advance robot-assisted surgical applications. Our code is available at https://github.com/lastbasket/Endo-4DGX.

内窥镜重建光照校正高斯点阵手术导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。