arXiv:2509.04444cs.CV2025-09综述被引 27

系统梳理全景视觉关键技术,揭示透视到全景的适配难题与解决方案

One Flight Over the Gap: A Survey from Perspective to Panoramic Vision

  • 从投影原理出发,分析全景图像与透视图的结构差异
  • 归纳三类核心挑战:极区畸变、等距投影采样不均、周期性边界问题
  • 覆盖20+任务、4大类别,适合视觉算法研究者参考

为满足空间智能与整体场景感知的需求,提供360°视场的全景图像(ODIs)在虚拟现实、自动驾驶和具身机器人等多领域日益受到关注。由于其在几何投影、空间分布和边界连续性上与透视图像存在显著差异,直接将透视方法迁移到全景场景面临挑战。本文系统回顾近年全景视觉技术,重点聚焦透视到全景的域适应问题。首先梳理全景成像流程与投影方法,建立分析结构差异的基础知识;随后总结三大域适应挑战:极区严重畸变、等距投影(ERP)中非均匀采样、周期性边界连续性问题。基于此,综合超过300篇论文,涵盖20余项代表性任务,从两个维度展开:一方面对比不同任务中应对全景特有挑战的策略,另一方面进行跨任务比较,将全景视觉划分为四大类:视觉质量增强与评估、视觉理解、多模态理解、视觉生成。此外,探讨数据、模型与应用层面的开放挑战与未来方向,期望为全景视觉技术发展提供新视角。项目页面:https://insta360-research-team.github.io/Survey-of-Panorama

原文摘要 · Abstract (English)

Driven by the demand for spatial intelligence and holistic scene perception, omnidirectional images (ODIs), which provide a complete 360\textdegree{} field of view, are receiving growing attention across diverse applications such as virtual reality, autonomous driving, and embodied robotics. Despite their unique characteristics, ODIs exhibit remarkable differences from perspective images in geometric projection, spatial distribution, and boundary continuity, making it challenging for direct domain adaption from perspective methods. This survey reviews recent panoramic vision techniques with a particular emphasis on the perspective-to-panorama adaptation. We first revisit the panoramic imaging pipeline and projection methods to build the prior knowledge required for analyzing the structural disparities. Then, we summarize three challenges of domain adaptation: severe geometric distortions near the poles, non-uniform sampling in Equirectangular Projection (ERP), and periodic boundary continuity. Building on this, we cover 20+ representative tasks drawn from more than 300 research papers in two dimensions. On one hand, we present a cross-method analysis of representative strategies for addressing panoramic specific challenges across different tasks. On the other hand, we conduct a cross-task comparison and classify panoramic vision into four major categories: visual quality enhancement and assessment, visual understanding, multimodal understanding, and visual generation. In addition, we discuss open challenges and future directions in data, models, and applications that will drive the advancement of panoramic vision research. We hope that our work can provide new insight and forward looking perspectives to advance the development of panoramic vision technologies. Our project page is https://insta360-research-team.github.io/Survey-of-Panorama

全景视觉域适应图像投影视觉理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。