arXiv:2411.18473cs.CV2024-11被引 39

用混合熵模型压缩3D高斯点云,存得更少画得更好。

HEMGS: A Hybrid Entropy Model for 3D Gaussian Splatting Data Compression

  • 单模型通过调节参数实现多速率压缩,降低训练开销。
  • 在四个数据集上平均压缩率提升40%,保持渲染质量。
  • 适合需要高效存储3D场景的图形与视觉应用开发者。

本文提出一种针对3D高斯点云(3DGS)数据的新压缩框架。基于锚点式3DGS方法,引入混合熵模型HEMGS,对每个锚点内的所有属性进行混合有损-无损压缩。该模型包含三个核心组件:可变率预测器、超先验网络和自回归网络。首先,与以往需多个模型实现多速率压缩不同,本文的可变率预测器仅用一个模型和一个超参数λ,通过生成学习的量化步长特征,实现灵活有损压缩。其次,为提升无损压缩性能,超先验网络同时捕捉场景无关与场景特定特征以生成先验特征;自回归网络采用自适应上下文选择算法和可变感受野生成上下文特征。融合两类特征后,HEMGS能精准估计各属性中当前编码元素的分布,提升熵编码效率,减少存储。将HEMGS集成至压缩框架后,在四个基准数据集上的实验表明,相比基线方法,平均存储量减少约40%,同时保持良好渲染质量,达到当前最优压缩效果。

原文摘要 · Abstract (English)

In this work, we propose a novel compression framework for 3D Gaussian Splatting (3DGS) data. Building on anchor-based 3DGS methodologies, our approach compresses all attributes within each anchor by introducing a novel Hybrid Entropy Model for 3D Gaussian Splatting (HEMGS) to achieve hybrid lossy-lossless compression. It consists of three main components: a variable-rate predictor, a hyperprior network, and an autoregressive network. First, unlike previous methods that adopt multiple models to achieve multi-rate lossy compression, thereby increasing training overhead, our variable-rate predictor enables variable-rate compression with a single model and a hyperparameter $λ$ by producing a learned Quantization Step feature for versatile lossy compression. Second, to improve lossless compression, the hyperprior network captures both scene-agnostic and scene-specific features to generate a prior feature, while the autoregressive network employs an adaptive context selection algorithm with flexible receptive fields to produce a contextual feature. By integrating these two features, HEMGS can accurately estimate the distribution of the current coding element within each attribute, enabling improved entropy coding and reduced storage. We integrate HEMGS into a compression framework, and experimental results on four benchmarks indicate that HEMGS achieves about a 40% average reduction in size while maintaining rendering quality over baseline methods and achieving state-of-the-art compression results.

3D压缩高斯点云熵编码混合压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。