arXiv:2606.24847cs.CV2026-06

将全景立体图像转为平面后,用旧方法实现快速准确的深度估计。

Spherical-to-ERP Epipolar Rectification for Single-Axis Disparity in 360 Stereo

  • 先将球面图像转为等距柱状图,使视差变为一维
  • 在合成鱼眼数据集上达到实时速度且结果平滑准确
  • 适合想用传统立体算法做360度深度估计的研究者

全景立体图像提供全向感知,但违背经典视差估计的几何假设:在球面或鱼眼视角下,视差对应路径为曲线,产生二维位移,无法直接视为单轴视差。本文采用标准的球面到等距柱状(ERP)投影作为预处理,将视差曲线拉直,恢复一维视差结构——左右排列时为水平方向,上下排列时为垂直方向。基于我们此前提出的RAFT + 等距对齐通道选择(EACS)框架,该框架最初用于平面和ERP立体图像,我们检验了当输入来自球面立体图像时,相同模块化流程是否仍保持精度。经过ERP投影后,从RAFT获得的稠密光流通过保留基线对齐分量,转化为视差。在合成鱼眼立体数据集上的实验表明,该球面→ERP→RAFT+EACS流程可实现实时速度下的高精度、平滑且结构一致的视差图。结果证实,成熟的ERP预处理可有效结合先前的RAFT+EACS方法,使传统立体算法适用于360度成像,为扩展常规立体管线提供了简单可行的路径。

原文摘要 · Abstract (English)

Omnidirectional stereo images provide full-surround perception but violate the geometric assumptions of classical disparity estimation: in spherical or fisheye views, epipolar correspondences follow curved great-circle paths, producing two-dimensional displacements that cannot be treated as single-axis disparity before geometric rectification. In this work, we adopt a standard spherical-to-equirectangular (ERP) projection as a preprocessing step, which straightens epipolar curves and restores a one-dimensional disparity structure - horizontal for left-right rigs and vertical for top-bottom rigs. Building on our previously introduced RAFT + Epipolar-Aligned Channel Selection (EACS) framework, originally developed for rectilinear and ERP stereo, we examine whether the same modular pipeline remains accurate when the input originates from spherical stereo imagery. After ERP projection, dense optical flow from RAFT is reduced to disparity by retaining only the baseline-aligned flow component. Experiments on synthetic fisheye stereo datasets show that this spherical-to-ERP-to-RAFT+EACS pipeline produces accurate, smooth, and structurally consistent disparity maps at real-time speed. These findings confirm that established ERP preprocessing can be effectively combined with our earlier RAFT+EACS method to enable practical, interpretable, and efficient disparity estimation from spherical stereo, providing a straightforward pathway for extending conventional stereo pipelines to 360 imaging.

立体匹配全景视觉深度估计图像转换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。