通过参数复用提升神经表示压缩效率
Releasing the Parameter Latency of Neural Representation for High-Efficiency Video Compression
- 利用深度网络实现参数复用,增强神经表示存储能力
- 实验表明率失真性能显著优于现有INR压缩方法
- 适合追求高效视频压缩的科研与工程人员
几十年来,视频压缩技术一直是研究热点。传统混合框架与端到端框架持续探索基于离散变换和深度学习的帧内与帧间参考及预测策略。然而,新兴的隐式神经表示(INR)技术将整个视频作为基本单元建模,自动捕捉帧内与帧间相关性,取得良好效果。INR使用紧凑神经网络将视频信息存储于网络参数中,有效消除原始视频的空间与时间冗余。然而本文通过探索与验证发现,当前INR视频压缩方法未能充分挖掘其保存信息的潜力。我们研究了通过参数复用增强网络参数存储的可行性,通过加深网络设计出可实现的INR参数复用方案,进一步提升压缩性能。大量实验结果表明,该方法显著提升了INR视频压缩的率失真性能。
原文摘要 · Abstract (English)
For decades, video compression technology has been a prominent research area. Traditional hybrid video compression framework and end-to-end frameworks continue to explore various intra- and inter-frame reference and prediction strategies based on discrete transforms and deep learning techniques. However, the emerging implicit neural representation (INR) technique models entire videos as basic units, automatically capturing intra-frame and inter-frame correlations and obtaining promising performance. INR uses a compact neural network to store video information in network parameters, effectively eliminating spatial and temporal redundancy in the original video. However, in this paper, our exploration and verification reveal that current INR video compression methods do not fully exploit their potential to preserve information. We investigate the potential of enhancing network parameter storage through parameter reuse. By deepening the network, we designed a feasible INR parameter reuse scheme to further improve compression performance. Extensive experimental results show that our method significantly enhances the rate-distortion performance of INR video compression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。