arXiv:2509.04118eess.IVcs.AI2025-09中稿 · ACMMM 2025被引 11

提升神经视频编码效率,通过结构对齐与前瞻优化实现更优画质

EHVC: Efficient Hierarchical Reference and Quality Structure for Neural Video Coding

  • 设计分层多参考机制,使参考帧与质量层级匹配
  • 引入编码端前瞻上下文,增强质量结构表现
  • 分层质量缩放加随机训练,稳定推理时的画质输出

神经视频编码器(NVC)利用端到端学习,在编码效率上显著优于传统编码器。近期研究开始关注NVC中的质量结构,通过显式分层设计进行优化。然而,参考结构设计仍被忽视,而其应与分层质量结构对齐。此外,分层质量结构仍有优化空间。为此,我们提出EHVC,一种高效的分层神经视频编码器,包含三项关键创新:(1) 借鉴传统编码器设计的分层多参考方案,对齐参考与质量结构,解决参考-质量不匹配问题;(2) 采用前瞻策略,利用编码端未来帧上下文优化质量结构;(3) 采用逐层质量缩放与随机质量训练策略,稳定推理阶段的质量结构。实验表明,EHVC性能显著优于当前最优NVC。代码将公开于:https://github.com/bytedance/NEVC。

原文摘要 · Abstract (English)

Neural video codecs (NVCs), leveraging the power of end-to-end learning, have demonstrated remarkable coding efficiency improvements over traditional video codecs. Recent research has begun to pay attention to the quality structures in NVCs, optimizing them by introducing explicit hierarchical designs. However, less attention has been paid to the reference structure design, which fundamentally should be aligned with the hierarchical quality structure. In addition, there is still significant room for further optimization of the hierarchical quality structure. To address these challenges in NVCs, we propose EHVC, an efficient hierarchical neural video codec featuring three key innovations: (1) a hierarchical multi-reference scheme that draws on traditional video codec design to align reference and quality structures, thereby addressing the reference-quality mismatch; (2) a lookahead strategy to utilize an encoder-side context from future frames to enhance the quality structure; (3) a layer-wise quality scale with random quality training strategy to stabilize quality structures during inference. With these improvements, EHVC achieves significantly superior performance to the state-of-the-art NVCs. Code will be released in: https://github.com/bytedance/NEVC.

神经视频编码分层结构质量优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。