arXiv:2412.05808cs.CVcs.MM2024-12被引 10

通过智能调参实现3D高斯点云的精准压缩,适配不同网络条件。

SizeGS: Size-aware Compression of 3D Gaussian Splatting via Mixed Integer Programming

  • 基于混合整数规划,自动优化高斯点数量与属性位宽。
  • 在限定大小下最大化视觉质量,压缩后仍保持高保真度。
  • 适合需要快速适配带宽变化的3D内容传输与存储场景。

近期3D高斯点云(3DGS)在三维重建方面取得显著进展,但其庞大的数据量给传输与存储带来挑战。现有压缩方法难以适应动态网络带宽,导致资源浪费。本文提出尺寸感知压缩,旨在快速搜索合适超参数,将3DGS压缩至目标尺寸。通过测量分析,识别出影响尺寸的关键超参数:高斯点保留率与属性位宽设置。将超参数优化建模为混合整数非线性规划(MINLP)问题,目标是在满足尺寸预算的前提下最大化视觉质量。通过解耦策略,离散采样保留率,并利用整数线性规划(ILP)确定位宽。为加速求解,设计了质量损失估计器、校准尺寸估计器,并实现CUDA核函数。在多个3DGS变体上的实验表明,本方法在训练后压缩中达到最先进性能;经微调后,其质量可媲美依赖训练的领先方法。

原文摘要 · Abstract (English)

Recent advances in 3D Gaussian Splatting (3DGS) have greatly improved 3D reconstruction. However, its substantial data size poses a significant challenge for transmission and storage. While many compression techniques have been proposed, they fail to efficiently adapt to fluctuating network bandwidth, leading to resource wastage. We address this issue from the perspective of size-aware compression, where we aim to compress 3DGS to a desired size by quickly searching for suitable hyperparameters. Through a measurement study, we identify key hyperparameters that affect the size -- namely, the reserve ratio of Gaussians and bit-width settings for Gaussian attributes. Then, we formulate this hyperparameter optimization problem as a mixed-integer nonlinear programming (MINLP) problem, with the goal of maximizing visual quality while respecting the size budget constraint. To solve the MINLP, we decouple this problem into two parts: discretely sampling the reserve ratio and determining the bit-width settings using integer linear programming (ILP). To solve the ILP more quickly and accurately, we design a quality loss estimator and a calibrated size estimator, as well as implement a CUDA kernel. Extensive experiments on multiple 3DGS variants demonstrate that our method achieves state-of-the-art performance in post-training compression. Furthermore, our method can achieve comparable quality to leading training-required methods after fine-tuning.

3D重建模型压缩高斯点云智能调参

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。