arXiv:2606.02096cs.CV2026-06

用结构引导的样条曲线实现单目视频中动态3D高斯点的快速高保真重建。

WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos

论文配图:WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos
图 1 · 摘自论文原文
  • 通过结构代理图与三次埃尔米特样条结合,建模动态高斯点轨迹的结构性运动。
  • 在iPhone数据集上渲染速度比第二名WorldTree快10倍以上,且质量更优。
  • 适合需要实时重建动态场景的视觉应用,如AR/VR与机器人导航。

从单目视频中进行动态场景重建仍具挑战性,现有方法在有限多视角信息下难以兼顾全局结构一致性与局部细节。为此,我们提出WebSpline,一种新型动态3D高斯框架,可实现结构一致且高保真的单目视频重建,并支持快速渲染。其核心是结构感知样条(SIS)表示,通过可学习的三次埃尔米特样条建模每个动态高斯点的运动轨迹,并由辅助结构代理图(SPG)组织结构关系。该框架分两阶段优化:(i) 第一阶段基于2D点追踪初始化SPG,通过时间刚性正则化提升序列中运动物体的结构一致性;(ii) 第二阶段基于优化后的SPG初始化SIS表示,并在空间与结构邻域约束下进一步优化。推理时仅需评估学习到的SIS即可获得高斯运动,实现快速渲染。在iPhone和NVIDIA等挑战性单目动态场景基准上的实验表明,WebSpline在渲染质量上达到当前最优,且在iPhone数据集上比第二佳方法WorldTree快超10倍。

原文摘要 · Abstract (English)

Dynamic scene reconstruction from monocular videos remains highly challenging, as existing methods often struggle to balance global structural coherence and local fine-grained details under limited multi-view cues. To address this challenge, we propose WebSpline, a novel dynamic 3D Gaussian framework that enables structurally coherent and high-fidelity reconstruction from monocular videos with fast rendering. The core of WebSpline is the Structure-Informed Spline (SIS) representation, which models each dynamic Gaussian trajectory using a learnable cubic Hermite spline whose motion is structurally organized with an auxiliary Structural Proxy Graph (SPG). The proposed framework is optimized in two stages: (i) in the first stage, the SPG is initialized from 2D point tracks and refined with temporal rigidity regularization to establish structural coherence for moving objects across the sequence; and (ii) in the second stage, the SIS representation is initialized from the refined SPG and optimized under both spatial and structural neighborhood constraints. At inference, Gaussian motion is obtained solely by evaluating the learned SIS, enabling fast rendering. Extensive experiments on the challenging monocular dynamic scene benchmarks, iPhone and NVIDIA, demonstrate that our WebSpline achieves state-of-the-art rendering quality while rendering over 10 times faster than WorldTree, the second-best method on the iPhone dataset.

3D重建单目视频动态场景高斯溅射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。