RealOSR用单步去噪加速全景图像超分,真实退化建模更清晰。
RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutions
- 单步去噪+潜空间梯度路由,高效融合语义与多尺度特征
- 相比OmniSSR提升视觉质量,推理速度加快200倍以上
- 适合需要快速高质全景图生成的虚拟现实应用
全景图像超分辨率(ODISR)旨在将低分辨率(LR)全景图像(ODI)放大为高分辨率(HR),以满足180°×360°视口对高质量视觉内容的需求。现有方法受限于简化的退化假设(如双三次下采样),难以建模和利用真实世界退化信息。基于潜空间的扩散方法虽采用条件引导,但因数百次更新步骤和频繁使用VAE导致推理缓慢。为此,我们提出面向真实世界ODISR的扩散框架RealOSR,采用单步去噪范式中的高效潜空间条件引导。核心是轻量级模块Latent Gradient Alignment Routing(LaGAR),实现像素-潜空间有效交互,并在潜空间直接模拟梯度下降,从而利用去噪UNet捕获的语义丰富性与多尺度特征。相比最新扩散型方法OmniSSR,RealOSR在视觉质量上显著提升,且推理速度加速超过200倍。代码与模型将在录用后发布。
原文摘要 · Abstract (English)
Omnidirectional image super-resolution (ODISR) aims to upscale low-resolution (LR) omnidirectional images (ODIs) to high-resolution (HR), catering to the growing demand for detailed visual content across a $ 180^{\circ}\times360^{\circ}$ viewport. Existing ODISR methods are limited by simplified degradation assumptions (e.g., bicubic downsampling), failing to model and exploit the real-world degradation information. Recent latent-based diffusion approaches using condition guidance suffer from slow inference due to their hundreds of updating steps and frequent use of VAE. To tackle these challenges, we propose \textbf{RealOSR}, a diffusion-based framework tailored for real-world ODISR, featuring efficient latent-based condition guidance within a one-step denoising paradigm. Central to efficient latent-based condition guidance is the proposed \textbf{Latent Gradient Alignment Routing (LaGAR)}, a lightweight module that enables effective pixel-latent space interactions and simulates gradient descent directly in the latent space, thereby leveraging the semantic richness and multi-scale features captured by the denoising UNet. Compared to the recent diffusion-based ODISR method, OmniSSR, RealOSR achieves significant improvements in visual quality and over \textbf{200$\times$} inference acceleration. Our code and models will be released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。