arXiv:2501.03714cs.CV2025-01CVPR被引 30

用分层运动分解与时间区间自适应,让动态3D高斯点云更省存储且还原复杂动作。

MoDec-GS: Global-to-Local Motion Decomposition and Temporal Interval Adjustment for Compact Dynamic 3D Gaussian Splatting

  • 分全局与局部两层建模运动,先粗后细捕捉复杂动态
  • 模型规模减少70%,渲染质量不降反升
  • 适合需要高效重建动态场景的视觉系统开发者

3D Gaussian Splatting(3DGS)在场景表示与神经渲染方面取得显著进展,尤其在动态场景重建上投入大量研究。尽管现有方法在渲染质量和速度上表现优异,但仍面临存储开销大和难以表达复杂真实运动的问题。为此,我们提出MoDecGS,一种面向复杂动态视频的紧凑型高斯点云重建框架。通过引入全局到局部运动分解(GLMD),利用全局规范骨架(Global CS)与局部规范骨架(Local CS),将静态骨架表示扩展至动态视频重建。对于全局部分,提出全局锚点变形(GAD),直接变形隐式骨架属性(锚点位置、偏移及局部上下文特征)以高效表示整体运动;局部部分则通过显式局部高斯变形(LGD)精细调整细节运动。此外,引入时间区间自适应(TIA),在训练中自动调节每个局部骨架的时间覆盖范围,基于预设时间段数寻找最优分配。大量实验表明,相较于现有动态3D高斯方法,MoDecGS在真实动态视频上平均模型规模减少70%,同时保持甚至提升渲染质量。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has made significant strides in scene representation and neural rendering, with intense efforts focused on adapting it for dynamic scenes. Despite delivering remarkable rendering quality and speed, existing methods struggle with storage demands and representing complex real-world motions. To tackle these issues, we propose MoDecGS, a memory-efficient Gaussian splatting framework designed for reconstructing novel views in challenging scenarios with complex motions. We introduce GlobaltoLocal Motion Decomposition (GLMD) to effectively capture dynamic motions in a coarsetofine manner. This approach leverages Global Canonical Scaffolds (Global CS) and Local Canonical Scaffolds (Local CS), extending static Scaffold representation to dynamic video reconstruction. For Global CS, we propose Global Anchor Deformation (GAD) to efficiently represent global dynamics along complex motions, by directly deforming the implicit Scaffold attributes which are anchor position, offset, and local context features. Next, we finely adjust local motions via the Local Gaussian Deformation (LGD) of Local CS explicitly. Additionally, we introduce Temporal Interval Adjustment (TIA) to automatically control the temporal coverage of each Local CS during training, allowing MoDecGS to find optimal interval assignments based on the specified number of temporal segments. Extensive evaluations demonstrate that MoDecGS achieves an average 70% reduction in model size over stateoftheart methods for dynamic 3D Gaussians from realworld dynamic videos while maintaining or even improving rendering quality.

3D重建动态高斯压缩优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。