用图像先验修复3D高斯压缩失真,存得更少、画得更好。
Leveraging Learned Image Prior for 3D Gaussian Compression
- 用图像先验建模压缩失真,从低质量图中恢复细节
- 引入粗略渲染残差作为辅助信息,提升重建质量
- 兼容现有压缩方法,适合想省存储又保画质的开发者
3D高斯点云(3DGS)的压缩技术近年来在降低存储开销的同时保持了高渲染质量。尽管存储压缩效果显著,但缺乏学习到的先验知识限制了进一步优化率-失真权衡。为此,我们提出一种新框架,利用图像先验的强大表征能力来恢复压缩导致的质量退化。基于初始压缩后的高斯点,我们的恢复网络在图像空间中有效建模退化与原始高斯之间的压缩伪影。为提升率-失真性能,我们在恢复网络中加入粗略渲染残差作为侧信息。通过恢复图像的监督信号,压缩后的高斯点得到优化,形成高度紧凑且渲染表现更优的表示。该框架可兼容现有高斯压缩方法,在多个基准上验证了有效性,优于当前最优3DGS压缩方法,在显著降低存储需求的同时实现更佳渲染质量。
原文摘要 · Abstract (English)
Compression techniques for 3D Gaussian Splatting (3DGS) have recently achieved considerable success in minimizing storage overhead for 3D Gaussians while preserving high rendering quality. Despite the impressive storage reduction, the lack of learned priors restricts further advances in the rate-distortion trade-off for 3DGS compression tasks. To address this, we introduce a novel 3DGS compression framework that leverages the powerful representational capacity of learned image priors to recover compression-induced quality degradation. Built upon initially compressed Gaussians, our restoration network effectively models the compression artifacts in the image space between degraded and original Gaussians. To enhance the rate-distortion performance, we provide coarse rendering residuals into the restoration network as side information. By leveraging the supervision of restored images, the compressed Gaussians are refined, resulting in a highly compact representation with enhanced rendering performance. Our framework is designed to be compatible with existing Gaussian compression methods, making it broadly applicable across different baselines. Extensive experiments validate the effectiveness of our framework, demonstrating superior rate-distortion performance and outperforming the rendering quality of state-of-the-art 3DGS compression methods while requiring substantially less storage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。