首个多目标优化的3D高斯点云压缩与分割框架,兼顾传输效率与语义理解。
CSGaussian: Progressive Rate-Distortion Compression and Segmentation for 3D Gaussian Splatting
- 用轻量级神经隐式先验实现颜色和语义的高效熵编码
- 压缩引导分割使点元特征更可分,弱化低质量点元影响
- 在LERF和3D-OVS数据集上降低传输开销,保持高渲染与分割质量
我们提出首个针对3D高斯点云(3DGS)的速率-失真优化压缩与分割统一框架。尽管3DGS在实时渲染和语义场景理解方面表现优异,但以往工作多独立处理这两项任务,未探索其联合优化。受近期3DGS速率-失真压缩进展启发,本工作将语义学习融入压缩流程,支持解码端的场景编辑与操作等扩展应用。方案采用基于轻量级隐式神经表示的超先验,实现颜色与语义属性的高效熵编码,避免了传统网格型超先验的高开销。为促进压缩与分割协同,进一步设计压缩引导的分割学习:包括增强特征可分性的量化感知训练,以及抑制不可靠高斯点元的质量感知加权机制。在LERF和3D-OVS数据集上的大量实验表明,该方法显著降低传输成本,同时保持高渲染质量与强分割性能。
原文摘要 · Abstract (English)
We present the first unified framework for rate-distortion-optimized compression and segmentation of 3D Gaussian Splatting (3DGS). While 3DGS has proven effective for both real-time rendering and semantic scene understanding, prior works have largely treated these tasks independently, leaving their joint consideration unexplored. Inspired by recent advances in rate-distortion-optimized 3DGS compression, this work integrates semantic learning into the compression pipeline to support decoder-side applications--such as scene editing and manipulation--that extend beyond traditional scene reconstruction and view synthesis. Our scheme features a lightweight implicit neural representation-based hyperprior, enabling efficient entropy coding of both color and semantic attributes while avoiding costly grid-based hyperprior as seen in many prior works. To facilitate compression and segmentation, we further develop compression-guided segmentation learning, consisting of quantization-aware training to enhance feature separability and a quality-aware weighting mechanism to suppress unreliable Gaussian primitives. Extensive experiments on the LERF and 3D-OVS datasets demonstrate that our approach significantly reduces transmission cost while preserving high rendering quality and strong segmentation performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。