用视频压缩思路压缩动态3D场景,存储量降90倍
P-4DGS: Predictive 4D Gaussian Splatting with 90$\times$ Compression
- 通过时空预测模块挖掘3D高斯点的冗余性
- 实测合成场景压缩40倍,真实场景达90倍,仅需1MB
- 适合需要轻量化动态3D建模的实时应用
3D高斯泼溅(3DGS)因出色的场景重建精度和实时渲染性能,在动态3D场景重建(即4D重建)中备受关注。然而,现有方法普遍忽视动态场景中固有的时空冗余,导致内存开销巨大。为此,我们提出P-4DGS,一种新型紧凑型动态3DGS表示方法。受视频压缩中帧内与帧间预测启发,设计基于3D锚点的空间-时间预测模块,充分挖掘不同3D高斯基元间的时空相关性;随后采用自适应量化与上下文熵编码进一步压缩3D锚点,提升压缩效率。在合成与真实数据集上进行大量实验,结果表明,本方法在重建质量与渲染速度上均达当前最优,存储开销极低(平均约1MB),在合成与真实场景中分别实现40×与90×的压缩比。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has garnered significant attention due to its superior scene representation fidelity and real-time rendering performance, especially for dynamic 3D scene reconstruction (\textit{i.e.}, 4D reconstruction). However, despite achieving promising results, most existing algorithms overlook the substantial temporal and spatial redundancies inherent in dynamic scenes, leading to prohibitive memory consumption. To address this, we propose P-4DGS, a novel dynamic 3DGS representation for compact 4D scene modeling. Inspired by intra- and inter-frame prediction techniques commonly used in video compression, we first design a 3D anchor point-based spatial-temporal prediction module to fully exploit the spatial-temporal correlations across different 3D Gaussian primitives. Subsequently, we employ an adaptive quantization strategy combined with context-based entropy coding to further reduce the size of the 3D anchor points, thereby achieving enhanced compression efficiency. To evaluate the rate-distortion performance of our proposed P-4DGS in comparison with other dynamic 3DGS representations, we conduct extensive experiments on both synthetic and real-world datasets. Experimental results demonstrate that our approach achieves state-of-the-art reconstruction quality and the fastest rendering speed, with a remarkably low storage footprint (around \textbf{1MB} on average), achieving up to \textbf{40$\times$} and \textbf{90$\times$} compression on synthetic and real-world scenes, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。