arXiv:2511.21367cs.CV2025-11

解决内窥镜视频重建中几何漂移问题,提升动态场景下的形状准确性与时间一致性。

Endo-G$^{2}$T: Geometry-Guided & Temporally Aware Time-Embedded 4DGS For Endoscopic Scenes

  • 用深度先验蒸馏+渐进式注入,早期引导几何结构避免错误积累。
  • 引入时空联合参数化,实现平滑运动与清晰边界,保持时间连贯性。
  • 关键帧约束流式优化,高效稳定地处理长序列内窥镜视频。

内窥镜视频存在强烈的视角依赖效应,如高光、湿面反射和遮挡。纯光度监督与几何不一致,导致早期几何漂移,错误形状在密集化过程中被强化且难以修正。本文提出 Endo-G²T,一种面向时间嵌入4D高斯泼溅(4DGS)的几何引导与时间感知训练方案。首先,通过置信度门控单目深度生成尺度不变深度与梯度损失,采用从暖启动到上限的渐进式策略软注入先验,避免早期过拟合。其次,采用旋转变量化的时空高斯场,在XYZT空间建模动态,实现时间一致的几何结构,轻量正则化促进平滑运动与锐利不透明边界。第三,通过关键帧约束的流式优化,在最大点数预算下实现关键帧聚焦优化,非关键帧采用轻量更新,提升效率与长时序稳定性。在EndoNeRF与StereoMIS-P1数据集上,该方法在单目重建基线中达到最先进性能。

原文摘要 · Abstract (English)

Endoscopic (endo) video exhibits strong view-dependent effects such as specularities, wet reflections, and occlusions. Pure photometric supervision misaligns with geometry and triggers early geometric drift, where erroneous shapes are reinforced during densification and become hard to correct. We ask how to anchor geometry early for 4D Gaussian splatting (4DGS) while maintaining temporal consistency and efficiency in dynamic endoscopic scenes. Thus, we present Endo-G$^{2}$T, a geometry-guided and temporally aware training scheme for time-embedded 4DGS. First, geo-guided prior distillation converts confidence-gated monocular depth into supervision with scale-invariant depth and depth-gradient losses, using a warm-up-to-cap schedule to inject priors softly and avoid early overfitting. Second, a time-embedded Gaussian field represents dynamics in XYZT with a rotor-like rotation parameterization, yielding temporally coherent geometry with lightweight regularization that favors smooth motion and crisp opacity boundaries. Third, keyframe-constrained streaming improves efficiency and long-horizon stability through keyframe-focused optimization under a max-points budget, while non-keyframes advance with lightweight updates. Across EndoNeRF and StereoMIS-P1 datasets, Endo-G$^{2}$T achieves state-of-the-art results among monocular reconstruction baselines.

4DGS内窥镜几何引导时间一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。