arXiv:2503.12307cs.CVcs.AI2025-03ICLR被引 52

Swift4D用分治法高效重建动态场景,速度快20倍且仅需30MB存储。

Swift4D:Adaptive divide-and-conquer Gaussian Splatting for compact and efficient reconstruction of dynamic scene

  • 将静态与动态物体分离建模,只对动态部分做变形处理
  • 在真实数据集上训练速度达SOTA方法的20倍,存储仅需30MB
  • 适合需要快速高效重建动态场景的研究者和开发者

新视角合成长期以来是一个实用但具挑战性的任务,尽管已有诸多方法,甚至结合3D高斯点阵等先进表示,仍难以在高质量输出的同时避免过高的存储和训练开销。本文提出Swift4D,一种分治式3D高斯点阵方法,可分别处理静态与动态要素,实现渲染质量与效率的良好平衡。其核心思想是:场景中大部分为静态部分,无需额外动态属性。我们采用可学习分解策略,通过额外参数将要素分类为静态或动态;仅对动态要素使用紧凑的多分辨率4D哈希映射器,在每个时间戳将其从标准空间映射到形变空间,再融合静态与动态要素生成最终结果。该分治策略提升了训练效率并减少存储冗余。实验表明,本方法在真实数据集上达到当前最优渲染质量,训练速度比之前SOTA快20倍,存储需求低至仅30MB。代码已公开于https://github.com/WuJH2001/swift4d。

原文摘要 · Abstract (English)

Novel view synthesis has long been a practical but challenging task, although the introduction of numerous methods to solve this problem, even combining advanced representations like 3D Gaussian Splatting, they still struggle to recover high-quality results and often consume too much storage memory and training time. In this paper we propose Swift4D, a divide-and-conquer 3D Gaussian Splatting method that can handle static and dynamic primitives separately, achieving a good trade-off between rendering quality and efficiency, motivated by the fact that most of the scene is the static primitive and does not require additional dynamic properties. Concretely, we focus on modeling dynamic transformations only for the dynamic primitives which benefits both efficiency and quality. We first employ a learnable decomposition strategy to separate the primitives, which relies on an additional parameter to classify primitives as static or dynamic. For the dynamic primitives, we employ a compact multi-resolution 4D Hash mapper to transform these primitives from canonical space into deformation space at each timestamp, and then mix the static and dynamic primitives to produce the final output. This divide-and-conquer method facilitates efficient training and reduces storage redundancy. Our method not only achieves state-of-the-art rendering quality while being 20X faster in training than previous SOTA methods with a minimum storage requirement of only 30MB on real-world datasets. Code is available at https://github.com/WuJH2001/swift4d.

动态场景3D高斯高效重建分治法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。