用去噪参考图解决用户生成视频压缩质量饱和问题
Avoiding Quality Saturation in UGC Compression Using Denoised References
- 以去噪后画面为参考,计算新型失真度量D-MSE
- D-MSE随码率上升趋于非零饱和,可高效检测质量瓶颈
- 适合作为预处理步骤,提升视频压缩效率
视频平台需对大量噪声用户生成内容(UGC)重新编码以满足流媒体需求。传统编码器以最小化压缩后视频与输入视频之间的均方误差(MSE)为目标,在处理UGC时易引发质量饱和(QS)现象:提高码率无法消除输入噪声,视觉质量不再提升。现有方法通过多次评估非参考指标(NRM)检测QS,效率低下。本文从噪声源编码理论出发,提出使用去噪后的UGC作为替代参考,计算去噪参考均方误差(D-MSE)。与原始MSE不同,D-MSE在码率增加时趋于非零饱和,称为失真饱和(DS)。由于D-MSE可在变换域逐块计算,无需反复编码解码即可高效检测。文中提出两种检测方法:输入相关阈值的失真饱和检测(DSD),以及基于低复杂度压缩估计拉格朗日乘子的率失真饱和检测(RDSD)。两者均可作为预处理步骤,帮助标准编码器避免在质量饱和区编码。在AVC实验中,根据本方法避免饱和区域编码,相比忽略质量饱和的基线方法,在多个NRM下实现8%-20%的BD-rate节省。
原文摘要 · Abstract (English)
Video-sharing platforms must re-encode large volumes of noisy user-generated content (UGC) to meet streaming demands. However, conventional codecs, which aim to minimize the mean squared error (MSE) between the compressed and input videos, can cause quality saturation (QS) when applied to UGC, i.e., increasing the bitrate preserves input artifacts without improving visual quality. A direct approach to solve this problem is to detect QS by repeatedly evaluating a non-reference metric (NRM) on videos compressed with multiple codec parameters, which is inefficient. In this paper, we re-frame UGC compression and QS detection from the lens of noisy source coding theory: rather than using a NRM, we compute the MSE with respect to the denoised UGC, which serves as an alternative reference (D-MSE). Unlike MSE measured between the UGC input and the compressed UGC, D-MSE saturates at non-zero values as bitrates increase, a phenomenon we term distortion saturation (DS). Since D-MSE can be computed at the block level in the transform domain, we can efficiently detect D-MSE without coding and decoding with various parameters. We propose two methods for DS detection: distortion saturation detection (DSD), which relies on an input-dependent threshold derived from the D-MSE of the input UGC, and rate-distortion saturation detection (RDSD), which estimates the Lagrangian at the saturation point using a low-complexity compression method. Both methods work as a pre-processing step that can help standard-compliant codecs avoid QS in UGC compression. Experiments with AVC show that preventing encoding in the saturation region, i.e., avoiding encoding at QPs that result in QS according to our methods, achieves BD-rate savings of 8%-20% across multiple different NRMs, compared to a naïve baseline that encodes at the given input QP while ignoring QS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。