改进3D高斯点渲染的投影方式，减少模糊和伪影。
Projecting Gaussian Ellipsoids While Avoiding Affine Projection Approximation
- 用椭球投影替代传统仿射近似，更精准计算高斯椭球在图像平面的投影。
- 在多个基准数据集上提升渲染质量，显著减少模糊与不一致性。
- 适合关注高质量3D重建与实时渲染的研究者与开发者。
最近，3D高斯点阵（3D Gaussian Splatting）因其实时渲染速度和顶尖的渲染质量，在新视角合成领域占据主导地位。然而，在渲染过程中，使用投影变换的仿射近似所对应的雅可比矩阵会导致不可避免的误差，造成最终图像模糊、出现伪影且场景不一致。为解决该问题，本文提出一种基于椭球的投影方法，用于计算3D高斯点阵中高斯椭球在图像平面上的投影。由于该方法无法处理相机原点位于椭球内部或部分位于相机空间z=0以下的情况，我们设计了一种预过滤策略。在多个广泛采用的基准数据集上的实验表明，所提出的椭球投影方法能有效提升3D高斯点阵及其扩展方法的渲染质量。
原文摘要 · Abstract (English)
Recently, 3D Gaussian Splatting has dominated novel-view synthesis with its real-time rendering speed and state-of-the-art rendering quality. However, during the rendering process, the use of the Jacobian of the affine approximation of the projection transformation leads to inevitable errors, resulting in blurriness, artifacts and a lack of scene consistency in the final rendered images. To address this issue, we introduce an ellipsoid-based projection method to calculate the projection of Gaussian ellipsoid onto the image plane, which is the primitive of 3D Gaussian Splatting. As our proposed ellipsoid-based projection method cannot handle Gaussian ellipsoids with camera origins inside them or parts lying below $z=0$ plane in the camera space, we designed a pre-filtering strategy. Experiments over multiple widely adopted benchmark datasets show that our ellipsoid-based projection method can enhance the rendering quality of 3D Gaussian Splatting and its extensions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。