arXiv:2603.08503cs.CVcs.GR2026-03中稿 · IEEE/RSJ IROS 2026

解决全景图3D重建中的几何失真问题,提升渲染一致性。

Spherical-GOF: Geometry-Aware Panoramic Gaussian Opacity Fields for 3D Scene Reconstruction

  • 在单位球面上直接采样射线,实现全景渲染的几何一致交互。
  • 深度重投影误差降低57%,循环内点率提升21%。
  • 适用于无人机和四足机器人等真实场景,鲁棒性强。

全景图像因其宽视场在机器人和视觉领域日益普及。然而,将3D高斯溅射(3DGS)扩展到全景相机模型仍具挑战性,因现有方法针对透视投影设计,简单适配常引入失真和几何不一致。本文提出Spherical-GOF,一种基于高斯透明度场(GOF)的全景渲染框架。不同于基于投影的光栅化,Spherical-GOF在球面射线空间的单位球上直接进行GOF射线采样,实现全景渲染中射线与高斯体的一致交互。为提高球面射线投射的效率与鲁棒性,我们推导出保守的球面包围规则以实现快速射线-高斯剔除,并引入球面滤波方案,使高斯投影随全景像素采样畸变变化自适应调整。在标准全景基准(OmniBlender和OmniPhotos)上的大量实验表明,Spherical-GOF在保真度方面表现优异,几何一致性显著提升:相比最强基线,深度重投影误差降低57%,循环内点率提升21%。定性结果展示更清晰的深度图和更一致的法向图,且对全局全景旋转具有强鲁棒性。我们进一步在新提出的现实世界机器人全景数据集OmniRob上验证了泛化能力,涵盖无人机与四足平台。源代码与OmniRob数据集将发布于https://github.com/1170632760/Spherical-GOF。

原文摘要 · Abstract (English)

Omnidirectional images are increasingly used in robotics and vision due to their wide field of view. However, extending 3D Gaussian Splatting (3DGS) to panoramic camera models remains challenging, as existing formulations are designed for perspective projections and naive adaptations often introduce distortion and geometric inconsistencies. We present Spherical-GOF, an omnidirectional Gaussian rendering framework built upon Gaussian Opacity Fields (GOF). Unlike projection-based rasterization, Spherical-GOF performs GOF ray sampling directly on the unit sphere in spherical ray space, enabling consistent ray-Gaussian interactions for panoramic rendering. To make the spherical ray casting efficient and robust, we derive a conservative spherical bounding rule for fast ray-Gaussian culling and introduce a spherical filtering scheme that adapts Gaussian footprints to distortion-varying panoramic pixel sampling. Extensive experiments on standard panoramic benchmarks (OmniBlender and OmniPhotos) demonstrate competitive photometric quality and substantially improved geometric consistency. Compared with the strongest baseline, Spherical-GOF reduces depth reprojection error by 57% and improves cycle inlier ratio by 21%. Qualitative results show cleaner depth and more coherent normal maps, with strong robustness to global panorama rotations. We further validate generalization on OmniRob, a real-world robotic omnidirectional dataset introduced in this work, featuring UAV and quadruped platforms. The source code and the OmniRob dataset will be released at https://github.com/1170632760/Spherical-GOF.

全景重建3D高斯几何一致性机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。