arXiv:2503.00357cs.CV2025-03ICLR被引 51

提出新型3D高斯图压缩方法,提升传输效率与画质平衡。

CAT-3DGS: A Context-Adaptive Triplane Approach to Rate-Distortion-Optimized 3DGS Compression

  • 用自适应三平面捕捉3D高斯点间空间相关性,支持高效编码。
  • 结合通道级自回归编码,挖掘单个高斯点内部特征关联。
  • 引入视图频率感知掩码,跳过低影响点,提升压缩效率。

3D高斯喷溅(3DGS)作为一种新兴的3D表示方法,近年来备受关注。尽管已有大量研究致力于降低其存储和内存开销,但将其压缩并远距离传输的需求仍被忽视。本工作针对3DGS的率失真优化压缩问题,提出CAT-3DGS,一种基于上下文自适应三平面的方法。该方法构建多尺度三平面,其方向依据3D空间中高斯点的主轴对齐,以捕获其空间相关性,支持在投影2D平面上进行空间自回归编码。利用这些三平面作为超先验,进一步实施通道级自回归编码,以挖掘每个高斯点内部的内在相关性。此外,引入视图频率感知掩码机制,主动跳过对渲染质量影响较小的高斯点,避免冗余编码。在真实世界数据集上端到端训练后,CAT-3DGS在率失真权衡上达到当前最优压缩性能。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has recently emerged as a promising 3D representation. Much research has been focused on reducing its storage requirements and memory footprint. However, the needs to compress and transmit the 3DGS representation to the remote side are overlooked. This new application calls for rate-distortion-optimized 3DGS compression. How to quantize and entropy encode sparse Gaussian primitives in the 3D space remains largely unexplored. Few early attempts resort to the hyperprior framework from learned image compression. But, they fail to utilize fully the inter and intra correlation inherent in Gaussian primitives. Built on ScaffoldGS, this work, termed CAT-3DGS, introduces a context-adaptive triplane approach to their rate-distortion-optimized coding. It features multi-scale triplanes, oriented according to the principal axes of Gaussian primitives in the 3D space, to capture their inter correlation (i.e. spatial correlation) for spatial autoregressive coding in the projected 2D planes. With these triplanes serving as the hyperprior, we further perform channel-wise autoregressive coding to leverage the intra correlation within each individual Gaussian primitive. Our CAT-3DGS incorporates a view frequency-aware masking mechanism. It actively skips from coding those Gaussian primitives that potentially have little impact on the rendering quality. When trained end-to-end to strike a good rate-distortion trade-off, our CAT-3DGS achieves the state-of-the-art compression performance on the commonly used real-world datasets.

3D生成压缩高斯

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。