arXiv:2412.18834cs.MMcs.CV2024-12被引 5

用神经网络动态调整视频压缩参数,提升码率控制精度。

Adaptive Rate Control for Deep Video Compression with Rate-Distortion Prediction

  • 基于未编码帧直接学习码率-失真-参数关系,无需预编码。
  • 在小分组级别实现高精度码率控制,降低时延。
  • 自适应应对内容突变,减少画面质量波动,适合多分辨率视频。

深度视频压缩近年取得显著进展,性能超越传统方法。然而针对深度压缩的码率控制方案研究不足。本文提出一种基于神经网络的λ域码率控制方法,通过直接从原始帧学习码率-失真-λ(R-D-λ)关系,高效确定每帧编码参数λ,无需预编码即可实现高精度控制。该内容感知方案能缓解帧间质量波动,适应视频内容的突然变化。具体地,引入两个神经网络预测器,分别估计比特率与λ、失真与λ的关系,进而为每帧设定λ以达成目标码率。实验表明,本方法在小分组级别实现高码率控制精度,时间开销低,且有效缓解不同分辨率视频中的帧间质量波动。

原文摘要 · Abstract (English)

Deep video compression has made significant progress in recent years, achieving rate-distortion performance that surpasses that of traditional video compression methods. However, rate control schemes tailored for deep video compression have not been well studied. In this paper, we propose a neural network-based $λ$-domain rate control scheme for deep video compression, which determines the coding parameter $λ$ for each to-be-coded frame based on the rate-distortion-$λ$ (R-D-$λ$) relationships directly learned from uncompressed frames, achieving high rate control accuracy efficiently without the need for pre-encoding. Moreover, this content-aware scheme is able to mitigate inter-frame quality fluctuations and adapt to abrupt changes in video content. Specifically, we introduce two neural network-based predictors to estimate the relationship between bitrate and $λ$, as well as the relationship between distortion and $λ$ for each frame. Then we determine the coding parameter $λ$ for each frame to achieve the target bitrate. Experimental results demonstrate that our approach achieves high rate control accuracy at the mini-GOP level with low time overhead and mitigates inter-frame quality fluctuations across video content of varying resolutions.

视频压缩码率控制神经网络深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。