系统梳理全景图像视频超分辨率,构建真实退化数据集360Insta。
A Systematic Investigation on Deep Learning-Based Omnidirectional Image and Video Super-Resolution
- 综述深度学习在全景图像视频超分中的方法与进展。
- 提出360Insta真实退化数据集,覆盖光照、运动、曝光等复杂条件。
- 公开所有数据与工具,助力未来研究评估与模型泛化验证。
全景图像与视频超分辨率是低层视觉的关键课题,在虚拟现实和增强现实应用中至关重要。其目标是从低分辨率输入重建高分辨率图像或视频帧,提升细节保留能力,支持更精准的场景分析与理解。近年来,大量基于深度学习的新方法被提出,涵盖多样网络结构、损失函数、投影策略与训练数据集。本文系统回顾了全景图像与视频超分辨率的最新进展,聚焦深度学习方法。鉴于现有数据集多依赖合成退化,难以反映真实世界失真,本文构建了新数据集360Insta,包含在不同光照、运动与曝光条件下采集的真实退化全景图像与视频,填补了当前基准的空白,可更可靠评估超分辨率方法的泛化能力。我们在公共数据集及自建数据集上进行了全面的定性与定量评估,并系统总结研究现状,探讨未来方向。本文所有数据集、方法与评价指标均公开并持续更新。项目页面:https://github.com/nqian1/Survey-on-ODISR-and-ODVSR。
原文摘要 · Abstract (English)
Omnidirectional image and video super-resolution is a crucial research topic in low-level vision, playing an essential role in virtual reality and augmented reality applications. Its goal is to reconstruct high-resolution images or video frames from low-resolution inputs, thereby enhancing detail preservation and enabling more accurate scene analysis and interpretation. In recent years, numerous innovative and effective approaches have been proposed, predominantly based on deep learning techniques, involving diverse network architectures, loss functions, projection strategies, and training datasets. This paper presents a systematic review of recent progress in omnidirectional image and video super-resolution, focusing on deep learning-based methods. Given that existing datasets predominantly rely on synthetic degradation and fall short in capturing real-world distortions, we introduce a new dataset, 360Insta, that comprises authentically degraded omnidirectional images and videos collected under diverse conditions, including varying lighting, motion, and exposure settings. This dataset addresses a critical gap in current omnidirectional benchmarks and enables more robust evaluation of the generalization capabilities of omnidirectional super-resolution methods. We conduct comprehensive qualitative and quantitative evaluations of existing methods on both public datasets and our proposed dataset. Furthermore, we provide a systematic overview of the current status of research and discuss promising directions for future exploration. All datasets, methods, and evaluation metrics introduced in this work are publicly available and will be regularly updated. Project page: https://github.com/nqian1/Survey-on-ODISR-and-ODVSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。