arXiv:2512.04019cs.CVeess.IV2025-12被引 2

轻量级神经视频压缩模型,速度提升8倍且质量更优。

Ultra-lightweight Neural Video Representation Compression

  • 用多尺度特征网格提升低复杂度下的压缩性能
  • 相比C3模型,峰值信噪比和结构相似性分别提升21%和23%
  • 适合移动端或实时视频压缩场景

近期研究证明过拟合的隐式神经表示(INRs)可作为自编码器模型的替代方案用于神经视频压缩。其中,神经视频表示压缩(NVRC)是首个采用全端到端框架压缩INRs的方案,达到业界领先性能。此外,一些轻量级INR已实现与基线模型相当的性能,计算复杂度低于10k MACs/pixel。本文将NVRC扩展至轻量级表示,提出NVRC-Lite,包含两项关键改进:首先,在轻量级神经表示中引入多尺度特征网格,高分辨率网格显著提升了低复杂度下的性能;其次,针对现有INR通常使用自回归模型进行熵编码导致速度慢的问题,提出基于八叉树的上下文模型对高维特征网格进行熵编码,大幅加速编码模块。实验表明,NVRC-Lite在PSNR和MS-SSIM指标上相比最佳轻量级INR模型C3分别实现最高21.03%和23.06%的BD-rate降低,同时编码速度提升8.4倍,解码速度提升2.5倍。NVRC-Lite代码将公开。

原文摘要 · Abstract (English)

Recent works have demonstrated the viability of utilizing over-fitted implicit neural representations (INRs) as alternatives to autoencoder-based models for neural video compression. Among these INR-based video codecs, Neural Video Representation Compression (NVRC) was the first to adopt a fully end-to-end compression framework that compresses INRs, achieving state-of-the-art performance. Moreover, some recently proposed lightweight INRs have shown comparable performance to their baseline codecs with computational complexity lower than 10kMACs/pixel. In this work, we extend NVRC toward lightweight representations, and propose NVRC-Lite, which incorporates two key changes. Firstly, we integrated multi-scale feature grids into our lightweight neural representation, and the use of higher resolution grids significantly improves the performance of INRs at low complexity. Secondly, we address the issue that existing INRs typically leverage autoregressive models for entropy coding: these are effective but impractical due to their slow coding speed. In this work, we propose an octree-based context model for entropy coding high-dimensional feature grids, which accelerates the entropy coding module of the model. Our experimental results demonstrate that NVRC-Lite outperforms C3, one of the best lightweight INR-based video codecs, with up to 21.03% and 23.06% BD-rate savings when measured in PSNR and MS-SSIM, respectively, while achieving 8.4x encoding and 2.5x decoding speedup. The implementation of NVRC-Lite will be made available.

视频压缩轻量级模型神经表示熵编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。