用压缩特性预测视频质量,高效构建可迁移码率阶梯
Leveraging Compression to Construct Transferable Bitrate Ladders
- 分析源视频压缩前的感知特征,预测压缩后VMAF分数
- 相比传统方法,提升码率利用率且保持高质量体验
- 适合需要快速部署自适应编码系统的研发团队
近年来,基于每帧内容的视频编码技术在码率控制和用户体验方面显著优于传统恒定CRF编码和固定码率阶梯。这些技术表明,构建与内容无关的每帧码率阶梯可在多种网络条件下带来显著码率节省并提升观看体验。然而,为每个视频构建凸包会带来巨大计算开销。近期,基于机器学习的码率阶梯构建方法逐渐成为凸包构造的替代方案,通过从源视频提取特征,训练机器学习模型以生成自适应码率阶梯。本文提出一种新的基于机器学习的码率阶梯构建方法,通过分析压缩过程并在压缩前对源视频进行感知相关测量,准确预测压缩后视频的VMAF得分。我们在大规模视频数据集上评估了该框架相较于领先方法的性能表现。由于在每种编码设置下训练模型耗时较长,我们还研究了不同编码设置下每帧码率阶梯的表现。所有模型均使用Bjontegaard-delta指标,与固定码率阶梯及通过穷举编码获得的最佳凸包进行对比。
原文摘要 · Abstract (English)
Over the past few years, per-title and per-shot video encoding techniques have demonstrated significant gains as compared to conventional techniques such as constant CRF encoding and the fixed bitrate ladder. These techniques have demonstrated that constructing content-gnostic per-shot bitrate ladders can provide significant bitrate gains and improved Quality of Experience (QoE) for viewers under various network conditions. However, constructing a convex hull for every video incurs a significant computational overhead. Recently, machine learning-based bitrate ladder construction techniques have emerged as a substitute for convex hull construction. These methods operate by extracting features from source videos to train machine learning (ML) models to construct content-adaptive bitrate ladders. Here, we present a new ML-based bitrate ladder construction technique that accurately predicts the VMAF scores of compressed videos, by analyzing the compression procedure and by making perceptually relevant measurements on the source videos prior to compression. We evaluate the performance of our proposed framework against leading prior methods on a large corpus of videos. Since training ML models on every encoder setting is time-consuming, we also investigate how per-shot bitrate ladders perform under different encoding settings. We evaluate the performance of all models against the fixed bitrate ladder and the best possible convex hull constructed using exhaustive encoding with Bjontegaard-delta metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。