提升3D高斯点云渲染的视角一致性与实时性,减少画面闪烁和伪影。
Efficient Perspective-Correct 3D Gaussian Splatting Using Hybrid Transparency
- 采用分像素混合透明度技术,实现高质量抗混叠渲染。
- 无需矩阵求逆,数值稳定且支持退化点云的处理。
- 可独立集成,显著提升帧率与优化速度,适合实时场景重建。
3D高斯点云(3DGS)作为灵活的渲染基元,在逆向渲染与场景实时探索中表现优异。多视角一致性对场景重建收敛性和无伪影漫游至关重要。现有方法虽缓解了因透明度排序不一致导致的闪烁问题及2D点云的透视失真,但为满足实时性要求,常在大规模3D高斯透明度处理上妥协,反而引入新的不一致性。本文提出一种高效且视角准确的3D高斯渲染方法,结合逐像素混合透明度策略,在保持实时帧率的同时实现高保真混合效果。所提方法避免矩阵求逆,确保数值稳定性,无需特殊处理退化点云;混合透明度方案在渲染成本仅为传统方法几分之一的情况下,维持相近图像质量。我们还证明两项技术可独立部署。联合使用后,在常见基准上实现最高2倍帧率提升、2倍优化加速,且图像质量相当或更优,渲染伪影更少。
原文摘要 · Abstract (English)
3D Gaussian Splats (3DGS) have proven a versatile rendering primitive, both for inverse rendering as well as real-time exploration of scenes. In these applications, coherence across camera frames and multiple views is crucial, be it for robust convergence of a scene reconstruction or for artifact-free fly-throughs. Recent work started mitigating artifacts that break multi-view coherence, including popping artifacts due to inconsistent transparency sorting and perspective-correct outlines of (2D) splats. At the same time, real-time requirements forced such implementations to accept compromises in how transparency of large assemblies of 3D Gaussians is resolved, in turn breaking coherence in other ways. In our work, we aim at achieving maximum coherence, by rendering fully perspective-correct 3D Gaussians while using a high-quality approximation of accurate blending, hybrid transparency, on a per-pixel level, in order to retain real-time frame rates. Our fast and perspectively accurate approach for evaluation of 3D Gaussians does not require matrix inversions, thereby ensuring numerical stability and eliminating the need for special handling of degenerate splats, and the hybrid transparency formulation for blending maintains similar quality as fully resolved per-pixel transparencies at a fraction of the rendering costs. We further show that each of these two components can be independently integrated into Gaussian splatting systems. In combination, they achieve up to 2$\times$ higher frame rates, 2$\times$ faster optimization, and equal or better image quality with fewer rendering artifacts compared to traditional 3DGS on common benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。