用双参考帧提升视频压缩效率,降低内存占用。
MH-LVC: Multi-Hypothesis Temporal Prediction for Learned Conditional Residual Video Coding
- 采用长短参考帧结合的多假设预测机制
- 比VTM-17.0在低延迟B配置下PSNR更优
- 适合需要高效编码的实时视频应用
本文提出MH-LVC,一种基于条件残差视频编码框架的多假设时序预测方法,同时利用长短期参考帧。现有时序上下文挖掘方法虽性能优越,但需存储大量隐式上下文信息,导致解码时内存访问过高。MH-LVC通过仅保留多个长/短期参考帧,且每次预测仅使用两个参考帧来缓解该问题。解码帧缓冲管理使编码器可灵活利用长期关键帧减少时序误差传播,同时用短期参考帧降低预测误差。该缓冲策略使预测结构能自适应不同输入视频。实验表明,该方法在低延迟B配置下,于常见测试集上相较VTM-17.0在PSNR-RGB上表现更优,且优于当前先进学习型编码器(如DCVC-FM),同时所需解码帧缓冲更少,解码时间相近。
原文摘要 · Abstract (English)
This work, termed MH-LVC, presents a multi-hypothesis temporal prediction scheme that employs long- and short-term reference frames in a conditional residual video coding framework. Recent temporal context mining approaches to conditional video coding offer superior coding performance. However, the need to store and access a large amount of implicit contextual information extracted from past decoded frames in decoding a video frame poses a challenge due to excessive memory access. Our MH-LVC overcomes this issue by storing multiple long- and short-term reference frames but limiting the number of reference frames used at a time for temporal prediction to two. Our decoded frame buffer management allows the encoder to flexibly utilize the long-term key frames to mitigate temporal cascading errors and the short-term reference frames to minimize prediction errors. Moreover, our buffering scheme enables the temporal prediction structure to be adapted to individual input videos. While this flexibility is common in traditional video codecs, it has not been fully explored for learned video codecs. Extensive experiments show that the proposed method outperforms VTM-17.0 under the low-delay B configuration in terms of PSNR-RGB across commonly used test datasets, and performs comparably to the state-of-the-art learned codecs (e.g.~DCVC-FM) while requiring less decoded frame buffer and similar decoding time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。