用强化学习优化视频压缩码率分配,提升效率与稳定性。
Reinforced Rate Control for Neural Video Compression via Inter-Frame Rate-Distortion Awareness
- 基于强化学习构建逐帧决策框架,联合优化码率与编码参数
- 平均码率误差降至1.20%,典型场景下节省13.45%码率
- 不依赖GOP结构,适合实际部署,抗内容和带宽波动
神经视频压缩(NVC)展现出卓越的压缩效率,但有效的码率控制仍面临挑战,主要源于复杂的时序依赖关系。现有方案通常依赖帧内容捕捉失真关联,却忽视了因每帧编码参数变化引发的帧间码率依赖,导致码率分配不佳并产生级联决策问题。为此,我们提出一种基于强化学习(RL)的码率控制框架,将任务建模为逐帧顺序决策过程。每个帧中,一个RL智能体观察时空状态并选择编码参数,以优化反映率失真(R-D)性能和码率约束的长期奖励。与以往方法不同,本方法在单步内联合确定码率分配与编码参数,不受图像组(GOP)结构限制。在多种NVC架构上的实验表明,该方法将平均相对码率误差降低至1.20%,在典型GOP尺寸下最多节省13.45%码率,优于现有方法。此外,框架对内容变化和带宽波动具有更强鲁棒性,编码开销更低,极具实际部署价值。
原文摘要 · Abstract (English)
Neural video compression (NVC) has demonstrated superior compression efficiency, yet effective rate control remains a significant challenge due to complex temporal dependencies. Existing rate control schemes typically leverage frame content to capture distortion interactions, overlooking inter-frame rate dependencies arising from shifts in per-frame coding parameters. This often leads to suboptimal bitrate allocation and cascading parameter decisions. To address this, we propose a reinforcement-learning (RL)-based rate control framework that formulates the task as a frame-by-frame sequential decision process. At each frame, an RL agent observes a spatiotemporal state and selects coding parameters to optimize a long-term reward that reflects rate-distortion (R-D) performance and bitrate adherence. Unlike prior methods, our approach jointly determines bitrate allocation and coding parameters in a single step, independent of group of pictures (GOP) structure. Extensive experiments across diverse NVC architectures show that our method reduces the average relative bitrate error to 1.20% and achieves up to 13.45% bitrate savings at typical GOP sizes, outperforming existing approaches. In addition, our framework demonstrates improved robustness to content variation and bandwidth fluctuations with lower coding overhead, making it highly suitable for practical deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。