提出可调码率的神经编码量化方法,让视频压缩更快更省带宽。
On Quantizing Neural Representation for Variable-Rate Video Coding
- 通过调整预训练权重的量化参数实现可变码率,无需重训练。
- 支持最低至INT2的量化,编码速度提升8倍,重建损失极小。
- 首次建立神经表示视频编码的理论框架,适合视频压缩研究者。
本文提出NeuroQuant,一种针对非通用隐式神经表示视频编码(INR-VC)的后训练量化(PTQ)方法。不同于需为每个目标码率重训练权重的现有方法,我们假设通过调节预训练权重的量化参数即可实现可变码率。研究发现,传统忽略层间依赖的量化方法在非通用INR-VC模型中效果不佳。为此,我们将可变码率问题重新定义为混合精度量化,并建立敏感性准则的理论框架,实现细粒度速率控制。进一步提出全局校准与通道级量化策略,最小化量化误差,推导出面向表示的统一PTQ校准公式。实验表明,NeuroQuant在多种位宽量化下显著优于现有技术,编码速度最高提升8倍,支持低至INT2的量化且重建损失极小。本工作首次实现可变率INR-VC,为速率-失真优化研究奠定理论基础,相关代码已公开于https://github.com/Eric-qi/NeuroQuant。
原文摘要 · Abstract (English)
This work introduces NeuroQuant, a novel post-training quantization (PTQ) approach tailored to non-generalized Implicit Neural Representations for variable-rate Video Coding (INR-VC). Unlike existing methods that require extensive weight retraining for each target bitrate, we hypothesize that variable-rate coding can be achieved by adjusting quantization parameters (QPs) of pre-trained weights. Our study reveals that traditional quantization methods, which assume inter-layer independence, are ineffective for non-generalized INR-VC models due to significant dependencies across layers. To address this, we redefine variable-rate INR-VC as a mixed-precision quantization problem and establish a theoretical framework for sensitivity criteria aimed at simplified, fine-grained rate control. Additionally, we propose network-wise calibration and channel-wise quantization strategies to minimize quantization-induced errors, arriving at a unified formula for representation-oriented PTQ calibration. Our experimental evaluations demonstrate that NeuroQuant significantly outperforms existing techniques in varying bitwidth quantization and compression efficiency, accelerating encoding by up to eight times and enabling quantization down to INT2 with minimal reconstruction loss. This work introduces variable-rate INR-VC for the first time and lays a theoretical foundation for future research in rate-distortion optimization, advancing the field of video coding technology. The materials will be available at https://github.com/Eric-qi/NeuroQuant.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。