用图像条件控制压缩3D高斯点云,存得更小还能更新场景。
Image-Conditioned 3D Gaussian Splat Quantization
- 通过共享码本和联合优化点间与属性间相关性提升压缩效率。
- 压缩至千字节级仍保持高质量渲染,支持长期存档后场景更新。
- 适合需要海量3D场景存储与动态更新的应用场景。
3D高斯点阵(3DGS)因其高质量实时渲染而备受关注。尽管已有压缩方法用于存储受限设备部署,但存在两大局限:(1)仅能将中等规模场景压缩至兆字节级别,对大规模场景或场景集合仍不实用;(2)缺乏长期存档后应对场景变化的机制。为此,我们提出图像条件高斯点阵量化器(ICGS-Quantizer),显著提升压缩效率并支持存档后的场景自适应更新。该方法通过联合利用点间与属性间相关性,并采用跨所有训练场景共享的固定码本,应用于未见测试场景,避免每场景单独构建码本的开销。该策略将3DGS存储需求降至千字节级,同时保持视觉保真度。为实现存档后场景更新能力,解码过程以解码时捕获的图像为条件,编码、量化与解码流程联合训练,确保量化码本适用于条件解码。我们在3D场景压缩与3D场景更新任务上评估了ICGS-Quantizer,结果表明其在压缩效率与场景变化适应性方面持续优于现有最先进方法。代码、模型与数据将公开发布于GitHub。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has attracted considerable attention for enabling high-quality real-time rendering. Although 3DGS compression methods have been proposed for deployment on storage-constrained devices, two limitations hinder archival use: (1) they compress medium-scale scenes only to the megabyte range, which remains impractical for large-scale scenes or extensive scene collections; and (2) they lack mechanisms to accommodate scene changes after long-term archival. To address these limitations, we propose an Image-Conditioned Gaussian Splat Quantizer (ICGS-Quantizer) that substantially enhances compression efficiency and provides adaptability to scene changes after archiving. ICGS-Quantizer improves quantization efficiency by jointly exploiting inter-Gaussian and inter-attribute correlations and by using shared codebooks across all training scenes, which are then fixed and applied to previously unseen test scenes, eliminating the overhead of per-scene codebooks. This approach effectively reduces the storage requirements for 3DGS to the kilobyte range while preserving visual fidelity. To enable adaptability to post-archival scene changes, ICGS-Quantizer conditions scene decoding on images captured at decoding time. The encoding, quantization, and decoding processes are trained jointly, ensuring that the codes, which are quantized representations of the scene, are effective for conditional decoding. We evaluate ICGS-Quantizer on 3D scene compression and 3D scene updating. Experimental results show that ICGS-Quantizer consistently outperforms state-of-the-art methods in compression efficiency and adaptability to scene changes. Our code, model, and data will be publicly available on GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。