arXiv:2502.04734cs.CVcs.GR2025-02ICLR被引 9

直接处理360图像,实现无须标定的高精度全景辐射场重建。

SC-OmniGS: Self-Calibrating Omnidirectional Gaussian Splatting

  • 将360图像视为完整球面,联合优化相机位姿与3D高斯点
  • 在无初始位姿条件下仍能重建高质量全景辐射场
  • 适用于消费级全景相机,有效降低真实数据畸变

360度相机通过捕捉完整场景数据,简化了辐射场三维重建的数据采集过程。然而,传统辐射场方法未解决360度图像特有的挑战。本文提出SC-OmniGS,一种自校准的全景高斯点积系统,可利用360度图像实现快速准确的全景辐射场重建。不同于将360图像转换为立方体图并进行透视校准,我们将其整体视为球面,建立数学框架以实现直接的全景相机位姿校准,并联合优化3D高斯点。此外,引入可微分的全景相机模型,以校正真实数据的畸变,提升性能。整体上,全景相机内参、外参位姿与3D高斯点通过最小化加权球面光度损失联合优化。大量实验表明,即使在噪声位姿或无位姿先验的复杂场景(如大基线、非物体中心配置)下,所提方法仍能恢复高质量辐射场。在消费级全景相机采集的真实数据集上的显著性能提升,验证了通用全景相机模型对减少360图像畸变的有效性。

原文摘要 · Abstract (English)

360-degree cameras streamline data collection for radiance field 3D reconstruction by capturing comprehensive scene data. However, traditional radiance field methods do not address the specific challenges inherent to 360-degree images. We present SC-OmniGS, a novel self-calibrating omnidirectional Gaussian splatting system for fast and accurate omnidirectional radiance field reconstruction using 360-degree images. Rather than converting 360-degree images to cube maps and performing perspective image calibration, we treat 360-degree images as a whole sphere and derive a mathematical framework that enables direct omnidirectional camera pose calibration accompanied by 3D Gaussians optimization. Furthermore, we introduce a differentiable omnidirectional camera model in order to rectify the distortion of real-world data for performance enhancement. Overall, the omnidirectional camera intrinsic model, extrinsic poses, and 3D Gaussians are jointly optimized by minimizing weighted spherical photometric loss. Extensive experiments have demonstrated that our proposed SC-OmniGS is able to recover a high-quality radiance field from noisy camera poses or even no pose prior in challenging scenarios characterized by wide baselines and non-object-centric configurations. The noticeable performance gain in the real-world dataset captured by consumer-grade omnidirectional cameras verifies the effectiveness of our general omnidirectional camera model in reducing the distortion of 360-degree images.

全景重建高斯点积相机校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。