用三维点云重构全景图,解决传统拼接的扭曲和重影问题。
LiftProj: Space Lifting and Projection-Based Panorama Stitching
- 将图像升维为三维点云,在统一坐标系中融合多视角信息。
- 通过三维投影生成无畸变的360°全景图,减少遮挡和错位。
- 适合复杂场景、大视差的全景拼接,如无人机或VR拍摄。
传统图像拼接依赖二维单应变换和网格变形,适用于近似共面或视差小的场景;但在存在多层深度与遮挡的真实三维场景中,此类方法常导致鬼影、结构弯曲与拉伸失真,尤其在多视角累积与360°闭环拼接时更为明显。为此,本文提出一种基于空间升维与投影的全景拼接框架:首先将每幅输入图像升维至统一坐标系中的稠密三维点表示,实现跨视角全局融合并引入置信度度量;随后在三维空间中建立统一投影中心,采用等距圆柱投影将融合数据映射到单一全景流形,生成几何一致的360°全景布局;最后在画布域内进行空洞填充,修复视点切换带来的未知区域,恢复连续纹理与语义连贯性。该框架将拼接从二维形变范式重构为三维一致性范式,可灵活集成各类三维升维与补全模块。实验表明,该方法在显著视差与复杂遮挡场景下大幅减轻几何畸变与鬼影伪影,生成更自然、一致的全景结果。
原文摘要 · Abstract (English)
Traditional image stitching techniques have predominantly utilized two-dimensional homography transformations and mesh warping to achieve alignment on a planar surface. While effective for scenes that are approximately coplanar or exhibit minimal parallax, these approaches often result in ghosting, structural bending, and stretching distortions in non-overlapping regions when applied to real three-dimensional scenes characterized by multiple depth layers and occlusions. Such challenges are exacerbated in multi-view accumulations and 360° closed-loop stitching scenarios. In response, this study introduces a spatially lifted panoramic stitching framework that initially elevates each input image into a dense three-dimensional point representation within a unified coordinate system, facilitating global cross-view fusion augmented by confidence metrics. Subsequently, a unified projection center is established in three-dimensional space, and an equidistant cylindrical projection is employed to map the fused data onto a single panoramic manifold, thereby producing a geometrically consistent 360° panoramic layout. Finally, hole filling is conducted within the canvas domain to address unknown regions revealed by viewpoint transitions, restoring continuous texture and semantic coherence. This framework reconceptualizes stitching from a two-dimensional warping paradigm to a three-dimensional consistency paradigm and is designed to flexibly incorporate various three-dimensional lifting and completion modules. Experimental evaluations demonstrate that the proposed method substantially mitigates geometric distortions and ghosting artifacts in scenarios involving significant parallax and complex occlusions, yielding panoramic results that are more natural and consistent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。