针对大场景3D高斯溅射的有限位移重建,提出新型球坐标量化方法。
3DOF+Quantization: 3DGS quantization for large scenes with limited Degrees of Freedom
- 基于球坐标设计新量化方案,适应相机位置受限的3DoF+场景
- 投影误差与点距平方成反比,远点更敏感于位置误差
- 在Garden数据集上实现更好率失真性能,适合大场景轻量化重建
3D高斯溅射(3DGS)是3D场景重建的重大突破。通过多视角输入,该算法训练由3D高斯组成的模型,可生成任意视角的新视图,实现6自由度(6DoF)的自由观察。然而,在大场景中,输入视角通常来自空间中有限区域,重建价值主要集中在该区域附近的视角,即使场景本身几乎无限延伸。这种情况称为3DoF+,即相机位置仅在中心点附近小范围移动。本文研究坐标量化对投影误差的影响,发现投影误差与被投影点距离的平方成反比。基于此,提出一种基于球坐标的新型量化方案。在著名的Garden场景上展示了该方法的率失真性能。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) is a major breakthrough in 3D scene reconstruction. With a number of views of a given object or scene, the algorithm trains a model composed of 3D gaussians, which enables the production of novel views from arbitrary points of view. This freedom of movement is referred to as 6DoF for 6 degrees of freedom: a view is produced for any position (3 degrees), orientation of camera (3 other degrees). On large scenes, though, the input views are acquired from a limited zone in space, and the reconstruction is valuable for novel views from the same zone, even if the scene itself is almost unlimited in size. We refer to this particular case as 3DoF+, meaning that the 3 degrees of freedom of camera position are limited to small offsets around the central position. Considering the problem of coordinate quantization, the impact of position error on the projection error in pixels is studied. It is shown that the projection error is proportional to the squared inverse distance of the point being projected. Consequently, a new quantization scheme based on spherical coordinates is proposed. Rate-distortion performance of the proposed method are illustrated on the well-known Garden scene.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。