提出3DGEER,实现通用相机下精确高效3D高斯渲染
3DGEER: 3D Gaussian Rendering Made Exact and Efficient for Generic Cameras
- 从几何原理解析射线与高斯积分,实现任意相机模型下的精确渲染
- 在pinhole和鱼眼数据集上均超越现有方法,速度比精确基线快5倍
- 适合需要高精度广角渲染的实时场景重建应用
3D高斯点云渲染(3DGS)在渲染质量与效率间取得良好平衡,但依赖将3D高斯近似为2D投影,该假设在通用大视场(FoV)相机下会降低精度。尽管已有扩展工作,但尚未有方法同时实现投影精确性与实时效率。本文提出3DGEER,一种几何精确且高效的高斯渲染框架。基于物理原理,推导出沿射线积分高斯密度的闭式表达式,支持任意相机模型下的精确前向渲染与可微优化。为保持效率,提出粒子包围视锥(PBF),无需遍历BVH即可实现紧密的射线-高斯关联;并设计双极等角投影(BEAP),统一视场表示,加速关联过程并提升重建质量。在针孔与鱼眼数据集上的实验表明,3DGEER在所有指标上均优于先前方法,运行速度比现有基于射线的精确基线快5倍,且能泛化至训练时未见的更宽视场,确立了实时辐射场渲染的新基准。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) achieves an appealing balance between rendering quality and efficiency, but relies on approximating 3D Gaussians as 2D projections--an assumption that degrades accuracy, especially under generic large field-of-view (FoV) cameras. Despite recent extensions, no prior work has simultaneously achieved both projective exactness and real-time efficiency for general cameras. We introduce 3DGEER, a geometrically exact and efficient Gaussian rendering framework. From first principles, we derive a closed-form expression for integrating Gaussian density along a ray, enabling precise forward rendering and differentiable optimization under arbitrary camera models. To retain efficiency, we propose the Particle Bounding Frustum (PBF), which provides tight ray-Gaussian association without BVH traversal, and the Bipolar Equiangular Projection (BEAP), which unifies FoV representations, accelerates association, and improves reconstruction quality. Experiments on both pinhole and fisheye datasets show that 3DGEER outperforms prior methods across all metrics, runs 5x faster than existing projective exact ray-based baselines, and generalizes to wider FoVs unseen during training--establishing a new state of the art in real-time radiance field rendering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。