让3D高斯点自由移动，实时重建复杂动态场景
FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstruction
- 高斯点可任意时间、任意位置出现，突破静态空间限制
- 引入运动函数使点随时间迁移，显著减少时间冗余
- 在多个数据集上渲染质量大幅超越现有方法
本文针对复杂运动动态三维场景重建难题提出FreeTimeGS。传统方法将高斯点定义在标准空间并用形变场映射到观测空间，但难以优化形变场。为此，我们提出一种新型4D表示，使高斯点可在任意时间与位置生成，具备更强灵活性。每个高斯点配备运动函数，可随时间迁移到邻近区域，有效降低时间冗余。在多个数据集上的实验表明，本方法的渲染质量显著优于近期方法。
原文摘要 · Abstract (English)
This paper addresses the challenge of reconstructing dynamic 3D scenes with complex motions. Some recent works define 3D Gaussian primitives in the canonical space and use deformation fields to map canonical primitives to observation spaces, achieving real-time dynamic view synthesis. However, these methods often struggle to handle scenes with complex motions due to the difficulty of optimizing deformation fields. To overcome this problem, we propose FreeTimeGS, a novel 4D representation that allows Gaussian primitives to appear at arbitrary time and locations. In contrast to canonical Gaussian primitives, our representation possesses the strong flexibility, thus improving the ability to model dynamic 3D scenes. In addition, we endow each Gaussian primitive with an motion function, allowing it to move to neighboring regions over time, which reduces the temporal redundancy. Experiments results on several datasets show that the rendering quality of our method outperforms recent methods by a large margin. Project page: https://zju3dv.github.io/freetimegs/ .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。