提出一种动态3D高斯表示的高效压缩方法,实现时间可控的变形与低码率重建。
TED-4DGS: Temporally Activated and Embedding-based Deformation for 4DGS Compression
- 用可学习的时间激活参数控制每个高斯点的出现消失,结合轻量嵌入查询变形库。
- 在真实数据集上达到当前最优率失真性能,压缩效率显著提升。
- 适合做动态3D场景建模与视频级3D内容压缩的研究者和开发者。
基于静态3D高斯溅射(3DGS)在三维场景表示中的成功,其向动态场景的扩展——即4DGS或动态3DGS——正受到越来越多关注。然而,设计更紧凑高效的变形方案,以及针对动态3DGS表示的率失真优化压缩策略,仍是一个未充分探索的领域。现有方法或依赖时空4DGS中过参数化、短寿命的高斯点,或采用无显式时间控制的原始3DGS变形。为此,我们提出TED-4DGS,一种时间激活且基于嵌入的变形方案,用于率失真优化的4DGS压缩,融合了两类方法的优势。TED-4DGS基于稀疏锚点3DGS表示,每个原始锚点分配可学习的时间激活参数以指定其随时间的外观变化,同时通过轻量级每锚点时间嵌入查询共享变形库生成锚点特定的形变。为实现率失真压缩,引入基于隐式神经表示(INR)的超先验建模锚点属性分布,并使用通道自回归模型捕捉锚点内相关性。这些新组件使本方案在多个真实世界数据集上达到当前最优率失真性能。据我们所知,这是首个致力于动态3DGS表示率失真优化压缩框架的工作。
原文摘要 · Abstract (English)
Building on the success of 3D Gaussian Splatting (3DGS) in static 3D scene representation, its extension to dynamic scenes, commonly referred to as 4DGS or dynamic 3DGS, has attracted increasing attention. However, designing more compact and efficient deformation schemes together with rate-distortion-optimized compression strategies for dynamic 3DGS representations remains an underexplored area. Prior methods either rely on space-time 4DGS with overspecified, short-lived Gaussian primitives or on canonical 3DGS with deformation that lacks explicit temporal control. To address this, we present TED-4DGS, a temporally activated and embedding-based deformation scheme for rate-distortion-optimized 4DGS compression that unifies the strengths of both families. TED-4DGS is built on a sparse anchor-based 3DGS representation. Each canonical anchor is assigned learnable temporal-activation parameters to specify its appearance and disappearance transitions over time, while a lightweight per-anchor temporal embedding queries a shared deformation bank to produce anchor-specific deformation. For rate-distortion compression, we incorporate an implicit neural representation (INR)-based hyperprior to model anchor attribute distributions, along with a channel-wise autoregressive model to capture intra-anchor correlations. With these novel elements, our scheme achieves state-of-the-art rate-distortion performance on several real-world datasets. To the best of our knowledge, this work represents one of the first attempts to pursue a rate-distortion-optimized compression framework for dynamic 3DGS representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。