提出SparseOIT,让透明物体3D高斯点云重建更快更准。
SparseOIT: Improving Order-Independent Transparency 3DGS via Active Set Method

- 利用主动集方法挖掘透明渲染中稀疏的依赖关系
- 加速比与潜在稀疏度成正比,实测速度提升显著
- 适合需要高效处理透明或非朗伯材质场景的研究者
3D高斯点云(3DGS)因其逼真的视觉效果近年来广受欢迎。然而,其基于体素渲染的方式不适用于非朗伯或透明材质物体。为解决此问题,一系列无序透明(OIT)渲染方法尝试移除或修改3DGS渲染方程中的深度排序步骤。但现有OIT方法的潜力尚未被充分挖掘。本文观察到,OIT对渲染方程的修改显著降低了高斯点之间的相互依赖性,形成高度稀疏的变量依赖结构,可被主动集优化方法有效利用。为此,我们提出SparseOIT——一种基于OIT的3DGS重建算法,通过维护一个高斯点的活跃集合,在稀疏度高的情况下实现与之成比例的加速。SparseOIT在设计中综合考虑了OIT渲染方程、重建算法与几何正则化。大量实验表明,SparseOIT在同类OIT方法中表现远超现有水平,且性能可媲美基于体素渲染的当前最优3DGS重建方法。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has received tremendous popularity over the past few years due to its photorealistic visual appearance. However, 3DGS uses volumetric rendering that is not suitable for objects with non-lambertian or transparent materials. To remedy this issue, a family of Order-Independent Transparency (OIT) rendering methods propose to remove or modify the depth sorting step in the 3DGS rendering equation. However, the potential of OIT-based method is still underexplored. In this paper, we observe that the OIT modifications to the rendering equation significantly reduce the inter-independence among individual gaussian splats, resulting in very sparse variable dependencies that can be harnessed by specific optimization techniques such as active set method. To this end, we propose SparseOIT, an OIT-based 3DGS reconstruction algorithm that maintains an active set of gaussian splats and enjoys an acceleration ratio that is proportional to the potential sparsity. SparseOIT is designed by jointly considering the OIT rendering equation, the reconstruction algorithm and the geometric regularization. Through extensive experiments, we demonstrate that SparseOIT outperforms existing methods in the OIT-family by a large margin and also achieves comparable performance to the state-of-the-art 3DGS reconstruction methods based on volumetric rendering. Project page:
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。