arXiv:2603.24770cs.CV2026-03

利用预扫描数据提升动态物体3D重建质量,解决视角极端时的失真问题。

DRoPS: Dynamic 3D Reconstruction of Pre-Scanned Objects

  • 用网格化高斯点构建表面对齐模型,约束几何结构
  • 通过卷积网络参数化运动,实现邻近点联动约束
  • 适合需要高精度3D重建的复杂动作场景应用

从日常视频中进行动态场景重建近年来取得显著进展。许多方法试图通过从2D基础模型中提取先验信息,并对优化运动施加手工设计的正则化来克服该任务的病态性。然而,这些方法在极端新视角下,尤其是面对高度灵活的动作时,重建效果不佳。本文提出DRoPS,一种新方法,利用动态物体的静态预扫描作为显式的几何与外观先验。现有最先进方法未能充分挖掘预扫描价值,而DRoPS通过新颖设置有效限制解空间,确保序列中几何一致性。其核心创新在于两点:第一,将高斯原语组织成锚定于物体表面的像素网格,建立网格结构且与表面对齐的模型;第二,借助原语的网格结构,使用基于网格的卷积网络参数化运动,注入强隐式正则化,并关联邻近点的运动。大量实验表明,本方法在渲染质量和3D跟踪精度上均显著优于当前最优水平。

原文摘要 · Abstract (English)

Dynamic scene reconstruction from casual videos has seen recent remarkable progress. Numerous approaches have attempted to overcome the ill-posedness of the task by distilling priors from 2D foundational models and by imposing hand-crafted regularization on the optimized motion. However, these methods struggle to reconstruct scenes from extreme novel viewpoints, especially when highly articulated motions are present. In this paper, we present DRoPS, a novel approach that leverages a static pre-scan of the dynamic object as an explicit geometric and appearance prior. While existing state-of-the-art methods fail to fully exploit the pre-scan, DRoPS leverages our novel setup to effectively constrain the solution space and ensure geometrical consistency throughout the sequence. The core of our novelty is twofold: first, we establish a grid-structured and surface-aligned model by organizing Gaussian primitives into pixel grids anchored to the object surface. Second, by leveraging the grid structure of our primitives, we parameterize motion using a CNN conditioned on those grids, injecting strong implicit regularization and correlating the motion of nearby points. Extensive experiments demonstrate that our method significantly outperforms the current state of the art in rendering quality and 3D tracking accuracy.

3D重建高斯泼溅动态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。