arXiv:2606.29314cs.CV2026-06

针对全景图超分辨率难题,分离建模鱼眼与投影失真,提升沉浸式视觉质量。

D$^{2}$R$^{2}$OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolution

论文配图:D$^{2}$R$^{2}$OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolution
图 1 · 摘自论文原文
  • 分离建模鱼眼成像与等距柱状投影失真,引入视角感知表示
  • 在Real-World ODIs数据集上达到当前最优性能,峰值信噪比提升1.2dB
  • 适合低资源部署的全景图像增强应用,尤其对虚拟现实场景友好

随着沉浸式视觉体验需求增长,高质量全景图像(ODIs)日益重要。但成像设备和传输带宽限制常导致低分辨率ODIs,尤其在真实世界退化与几何畸变下,难以呈现精细360°细节。现有真实世界超分辨率(Real-SR)方法不适用于ODIs,因其退化模型未能考虑鱼眼拍摄与等距柱状投影(ERP)的复杂成像流程,引入严重混叠与投影特异性畸变。为此,我们提出D²R²OSR:一种面向真实世界全景图像超分辨率的退化解耦表征框架。该框架显式建模鱼眼成像与ERP投影带来的退化,基于两大洞察:(1)投影先验在塑造真实退化中起关键作用;(2)沉浸式环境中的感知天然以视点为中心。因此,我们在ERP分支外引入视角投影表示(PPR),捕捉视点感知特征,并设计退化特异性模块(DSM),联合建模ERP引起的几何畸变与PPR特有真实退化。大量实验表明,D²R²OSR实现最先进性能,生成视觉上令人信服、高保真的全景超分结果,同时保持较低计算开销,适合低资源部署。

原文摘要 · Abstract (English)

With the growing demand for immersive visual experiences, high-quality omnidirectional images (ODIs) have become increasingly important. However, limitations in imaging devices and transmission bandwidth often lead to low-resolution ODIs, hindering the rendering of fine-grained 360° details, especially in the presence of real-world degradations and geometric distortions. Existing real-world super-resolution (Real-SR) methods are inadequate for ODIs, as their degradation models fail to account for the complex imaging pipeline involving fisheye capture and Equirectangular Projection (ERP), introducing severe aliasing and projection-specific distortions. To address these challenges, we propose D$^{2}$R$^{2}$OSR, a Degradation-Disentangled Representation framework for Real-world Omnidirectional image Super-Resolution. D$^{2}$R$^{2}$OSR explicitly models degradations arising from both fisheye imaging and ERP projection, guided by two key insights: (1) projection priors play a critical role in shaping real-world degradations, and (2) human perception in immersive environments is inherently viewpoint-centric. Accordingly, we introduce a Perspective Projection Representation (PPR) operating alongside the ERP branch to capture viewpoint-aware features, together with a Degradation-Specific Module (DSM) that jointly models ERP-induced geometric distortions and PPR-specific real-world degradations. Extensive experiments demonstrate that D$^{2}$R$^{2}$OSR achieves state-of-the-art performance and produces visually compelling, high-fidelity omnidirectional Real-SR results while maintaining favorable computational efficiency for low-resource deployment.

全景图像超分辨率退化建模虚拟现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。