arXiv:2503.13948cs.CV2025-03被引 11

轻量化动态3D高斯点云生成,压缩超120倍且提速20%

Light4GS: Lightweight Compact 4D Gaussian Splatting Generation via Context Model

  • 用上下文模型结合时空重要性剪枝,删减超64%动态点
  • 压缩后仍保持高质量渲染,速度提升20%,压缩比超120倍
  • 适合需要高效存储与实时渲染的动态场景应用

3D高斯点云(3DGS)已成为一种高效且高保真的新视角合成范式。为适应动态内容,可变形3DGS引入时序可变形原型和可学习的隐向量以捕捉复杂运动。尽管性能优异,但高维隐向量和大量原型导致存储开销巨大。本文提出轻量级4DGS框架Light4GS,通过深度上下文模型实现显著压缩。其核心包括:(1) 空间-时间重要性剪枝,剔除超过64%的可变形原型,并对剩余部分采用熵约束球谐函数压缩;(2) 深度上下文模型整合帧内与帧间预测及超先验,构建粗到细结构,实现多尺度隐向量高效压缩。相比基线4DGS,Light4GS实现超120倍压缩,渲染帧率提升最高20%,优于当前帧级最优3DGS压缩方法,验证了其在帧内与帧间预测上的有效性,且不损失渲染质量。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has emerged as an efficient and high-fidelity paradigm for novel view synthesis. To adapt 3DGS for dynamic content, deformable 3DGS incorporates temporally deformable primitives with learnable latent embeddings to capture complex motions. Despite its impressive performance, the high-dimensional embeddings and vast number of primitives lead to substantial storage requirements. In this paper, we introduce a \textbf{Light}weight \textbf{4}D\textbf{GS} framework, called Light4GS, that employs significance pruning with a deep context model to provide a lightweight storage-efficient dynamic 3DGS representation. The proposed Light4GS is based on 4DGS that is a typical representation of deformable 3DGS. Specifically, our framework is built upon two core components: (1) a spatio-temporal significance pruning strategy that eliminates over 64\% of the deformable primitives, followed by an entropy-constrained spherical harmonics compression applied to the remainder; and (2) a deep context model that integrates intra- and inter-prediction with hyperprior into a coarse-to-fine context structure to enable efficient multiscale latent embedding compression. Our approach achieves over 120x compression and increases rendering FPS up to 20\% compared to the baseline 4DGS, and also superior to frame-wise state-of-the-art 3DGS compression methods, revealing the effectiveness of our Light4GS in terms of both intra- and inter-prediction methods without sacrificing rendering quality.

3D高斯动态建模压缩轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。