POTR通过剪枝与光照重计算,大幅压缩3D高斯点云存储并提速渲染。
POTR: Post-Training 3DGS Compression
- 基于改进的光栅化器实现高效单点移除评估,剪枝后点数减少2-4倍。
- 光照系数熵降低,稀疏率从70%提升至97%,质量损失小。
- 无需训练即可加速推理1.5-2倍,适合实时3D渲染应用者。
3D高斯点云(3DGS)在3D场景重建与实时新视角合成中展现出超越神经辐射场(NeRF)的潜力,但其存储开销显著更高。为解决此问题,我们提出POTR——一种基于两项新技术的后训练3DGS编码器。首先,引入一种新型剪枝方法,利用改进的3DGS光栅化器同时高效计算每个点云的独立移除影响,使剪枝后点数比其他方法减少2-4倍,并在实验中实现1.5-2倍更快的推理速度。其次,提出一种无需训练的光照系数重计算方法,显著降低其熵值,尤其增强AC光照系数稀疏性,实验显示稀疏率从70%提升至97%,且质量损失极小。最后,通过简单的微调方案进一步优化剪枝、推理与率失真性能。实验表明,即使不使用微调,POTR在率失真表现和推理速度上均优于所有现有后训练压缩技术。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has recently emerged as a promising contender to Neural Radiance Fields (NeRF) in 3D scene reconstruction and real-time novel view synthesis. 3DGS outperforms NeRF in training and inference speed but has substantially higher storage requirements. To remedy this downside, we propose POTR, a post-training 3DGS codec built on two novel techniques. First, POTR introduces a novel pruning approach that uses a modified 3DGS rasterizer to efficiently calculate every splat's individual removal effect simultaneously. This technique results in 2-4x fewer splats than other post-training pruning techniques and as a result also significantly accelerates inference with experiments demonstrating 1.5-2x faster inference than other compressed models. Second, we propose a novel method to recompute lighting coefficients, significantly reducing their entropy without using any form of training. Our fast and highly parallel approach especially increases AC lighting coefficient sparsity, with experiments demonstrating increases from 70% to 97%, with minimal loss in quality. Finally, we extend POTR with a simple fine-tuning scheme to further enhance pruning, inference, and rate-distortion performance. Experiments demonstrate that POTR, even without fine-tuning, consistently outperforms all other post-training compression techniques in both rate-distortion performance and inference speed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。