解决360度视频低码率画质差问题，提升沉浸式体验。
360-Degree Video Super Resolution and Quality Enhancement Challenge: Methods and Results
- 设计双赛道挑战赛，针对2倍和4倍超分辨率优化模型
- 多模型对比显示，最佳方案在低码率下显著提升画质
- 适合关注VR/AR实时视频传输的研究者与工程师
全景（360度）视频因虚拟现实（VR）和扩展现实（XR）技术的发展而迅速普及。然而，在无人机等移动场景下的实时流媒体传输受限于带宽和严格的延迟要求。传统压缩与自适应分辨率方法虽有帮助，但常导致画质下降并引入伪影。此外，360度视频的球面几何特性带来传统2D视频未有的挑战。为此，我们发起360度视频超分辨率与画质增强挑战赛，鼓励开发高效的机器学习解决方案，以提升低码率压缩后的360度视频质量，设置2x和4x超分辨率两个赛道。本文介绍挑战框架，详述两赛道设计，并总结顶尖模型的解决方案。我们在统一评估框架下，综合考量画质提升、码率增益与计算效率。该挑战旨在推动实时360度视频流媒体创新，提升沉浸式视觉体验的质量与可及性。
原文摘要 · Abstract (English)
Omnidirectional (360-degree) video is rapidly gaining popularity due to advancements in immersive technologies like virtual reality (VR) and extended reality (XR). However, real-time streaming of such videos, especially in live mobile scenarios like unmanned aerial vehicles (UAVs), is challenged by limited bandwidth and strict latency constraints. Traditional methods, such as compression and adaptive resolution, help but often compromise video quality and introduce artifacts that degrade the viewer experience. Additionally, the unique spherical geometry of 360-degree video presents challenges not encountered in traditional 2D video. To address these issues, we initiated the 360-degree Video Super Resolution and Quality Enhancement Challenge. This competition encourages participants to develop efficient machine learning solutions to enhance the quality of low-bitrate compressed 360-degree videos, with two tracks focusing on 2x and 4x super-resolution (SR). In this paper, we outline the challenge framework, detailing the two competition tracks and highlighting the SR solutions proposed by the top-performing models. We assess these models within a unified framework, considering quality enhancement, bitrate gain, and computational efficiency. This challenge aims to drive innovation in real-time 360-degree video streaming, improving the quality and accessibility of immersive visual experiences.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。