解决双摄拼接中形变和伪影问题,让画面更自然真实。
Seamlessly Natural: Image Stitching with Natural Appearance Preservation
- 用分层仿射变形保持局部形状与平行性,避免传统方法的扭曲。
- 通过特征对应的一致性自动识别低视差区域,无需语义分割。
- 基于锚点的接缝切割确保一一对应,消除重影、模糊等瑕疵。
本文提出SENA(SEamlessly NAtural),一种以几何驱动为核心的图像拼接方法,针对具有视差和深度变化的复杂真实场景,优先保障结构保真度。传统拼接依赖单应性对齐,但在双摄像头场景中因平面假设失效,常导致明显扭曲与球面膨胀。SENA通过三项关键贡献突破这一局限:首先,采用分层仿射变形策略,结合全局仿射初始化与局部仿射优化及平滑自由形变,有效保持局部形状、平行性与长宽比,避免了单应性模型引入的幻觉形变;其次,提出基于几何的适宜区域检测机制,直接从RANSAC过滤后的特征对应一致性中识别视差最小区域,无需依赖语义分割;第三,在该适宜区域基础上进行基于锚点的接缝切割与分割,强制图像对之间构建一一对应的几何关系,显著消除最终全景图中的鬼影、重复和涂抹伪影。在多个挑战性数据集上的大量实验表明,SENA在对齐精度上达到主流单应性方法水平,同时在形状保持、纹理完整性和整体视觉真实感等关键视觉指标上显著优于现有方法。
原文摘要 · Abstract (English)
This paper introduces SENA (SEamlessly NAtural), a geometry-driven image stitching approach that prioritizes structural fidelity in challenging real-world scenes characterized by parallax and depth variation. Conventional image stitching relies on homographic alignment, but this rigid planar assumption often fails in dual-camera setups with significant scene depth, leading to distortions such as visible warps and spherical bulging. SENA addresses these fundamental limitations through three key contributions. First, we propose a hierarchical affine-based warping strategy, combining global affine initialization with local affine refinement and smooth free-form deformation. This design preserves local shape, parallelism, and aspect ratios, thereby avoiding the hallucinated structural distortions commonly introduced by homography-based models. Second, we introduce a geometry-driven adequate zone detection mechanism that identifies parallax-minimized regions directly from the disparity consistency of RANSAC-filtered feature correspondences, without relying on semantic segmentation. Third, building upon this adequate zone, we perform anchor-based seamline cutting and segmentation, enforcing a one-to-one geometric correspondence across image pairs by construction, which effectively eliminates ghosting, duplication, and smearing artifacts in the final panorama. Extensive experiments conducted on challenging datasets demonstrate that SENA achieves alignment accuracy comparable to leading homography-based methods, while significantly outperforming them in critical visual metrics such as shape preservation, texture integrity, and overall visual realism.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。