arXiv:2605.25563cs.CV2026-05被引 1

将3D高斯点云压缩至极小体积,支持快速传输与存储。

CodecSplat: Ultra-Compact Latent Coding for Feed-Forward 3D Gaussian Splatting

论文配图:CodecSplat: Ultra-Compact Latent Coding for Feed-Forward 3D Gaussian Splatting
图 1 · 摘自论文原文
  • 在中间2D特征层进行压缩编码,而非最终3D点云
  • 单场景仅需3.4-107.8KB,PSNR达24.8-27.1dB
  • 适合需要轻量化3D内容传输的实时应用

前馈式3D高斯点云渲染可在无场景优化情况下从稀疏视角重建可渲染的高斯原语,但现有方法未提供紧凑的场景表示以用于存储或传输。直接对生成的高斯原语进行压缩虽可行,但因其作用于不规则的3D表示且与特征生成过程脱钩,压缩效率受限。为此,本文提出CodecSplat,一种面向前馈3D高斯点云的超紧凑隐式编码框架。该框架首先将中间2D高斯生成特征编码为熵编码的场景比特流;解码端重构隐式特征并预测深度及高斯参数,进而映射为3D高斯原语。通过将压缩集成至前馈生成流程中,CodecSplat避免了对不规则3D原语的低效压缩,并利用结构化中间特征提升压缩性能。我们在具有深度引导多视图特征精炼的前馈高斯点云骨干网络上实现CodecSplat,采用分层学习的特征编码器。在DL3DV和RealEstate10K数据集上,CodecSplat实现23.56-26.36 dB和24.76-27.05 dB PSNR,单场景大小仅为20.00-107.77 KiB和3.37-12.51 KiB,相比直接压缩生成的高斯原语缩小约一个数量级,同时保持可控的率失真特性。

原文摘要 · Abstract (English)

While feed-forward 3D Gaussian splatting reconstructs renderable Gaussian primitives from sparse context views without per-scene optimization, existing pipelines do not provide a compact scene representation for storage or transmission. A natural solution is to apply existing 3DGS compression methods to the generated Gaussian primitives. However, this approach operates on the final irregular 3D representation and is decoupled from the internal feature-to-Gaussian generation process, which limits compression efficiency. To address this, we introduce CodecSplat, an ultra-compact latent coding framework for feed-forward 3D Gaussian splatting. CodecSplat first encodes an intermediate 2D Gaussian-generation feature into an entropy-coded scene bitstream. At the decoder, the latent feature is reconstructed and used to predict depth and Gaussian parameters, which are then mapped to 3D Gaussian primitives. Note that, by integrating compression into the feed-forward Gaussian generation pipeline, CodecSplat avoids inefficient compression over irregular 3D Gaussian primitives and allows the codec to exploit the structured intermediate feature representation. We instantiate CodecSplat on a feed-forward Gaussian splatting backbone with depth-guided multi-view feature refinement and a hierarchical learned feature codec. On DL3DV and RealEstate10K datasets, CodecSplat achieves 23.56-26.36 dB and 24.76-27.05 dB PSNR with only 20.00-107.77 KiB and 3.37-12.51 KiB per scene, respectively. This is roughly one order of magnitude smaller than compressing feed-forward generated Gaussian primitives, while preserving controllable rate-distortion behavior.

3D高斯压缩编码轻量化前馈渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。