针对云游戏压缩视频的超分辨率重建难题,提出轻量级新方法
Compressed Domain Prior-Guided Video Super-Resolution for Cloud Gaming Content
- 从编码先验中提取多层特征,融合U-net主干网络
- 采用重参数化块实现高效重建,显著减少块效应和振铃现象
- 设计分段焦点频率损失,更好保留图像高频细节,适合实时云游戏场景
云游戏是一种依赖本地终端在有限资源和低延迟条件下解码的互联网服务。超分辨率(SR)技术常被用于降低云游戏所需的比特率带宽。然而,现有研究对压缩游戏视频的超分辨率关注不足,多数网络在解码帧中放大了块效应和振铃现象,且忽略游戏内容的边缘细节,导致重建效果不佳。本文提出一种轻量级网络——编码先验引导超分辨率(CPGSR),以解决压缩游戏视频中的超分辨率挑战。首先,设计压缩域引导块(CDGB),从编码先验中提取不同深度的特征,并与U-net主干网络的特征融合;其次,使用一系列重参数化块进行重建;最后,受视频编码中量化启发,提出分段焦点频率损失,有效引导模型关注高频信息的保留。大量实验表明该方法具有明显优势。
原文摘要 · Abstract (English)
Cloud gaming is an advanced form of Internet service that necessitates local terminals to decode within limited resources and time latency. Super-Resolution (SR) techniques are often employed on these terminals as an efficient way to reduce the required bit-rate bandwidth for cloud gaming. However, insufficient attention has been paid to SR of compressed game video content. Most SR networks amplify block artifacts and ringing effects in decoded frames while ignoring edge details of game content, leading to unsatisfactory reconstruction results. In this paper, we propose a novel lightweight network called Coding Prior-Guided Super-Resolution (CPGSR) to address the SR challenges in compressed game video content. First, we design a Compressed Domain Guided Block (CDGB) to extract features of different depths from coding priors, which are subsequently integrated with features from the U-net backbone. Then, a series of re-parameterization blocks are utilized for reconstruction. Ultimately, inspired by the quantization in video coding, we propose a partitioned focal frequency loss to effectively guide the model's focus on preserving high-frequency information. Extensive experiments demonstrate the advancement of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。