通过残差连接与滤波网络提升视频压缩精度与质量。
Residual Learning and Filtering Networks for End-to-End Lossless Video Compression
- 采用带残差跳连的自编码器压缩运动信息,增强表达能力。
- 引入运动矢量与残差帧滤波网络,降低压缩误差。
- 适合关注高质量无损视频压缩的研究者与工程师。
现有基于学习的视频压缩方法仍面临运动估计不准确和运动补偿结构不足的问题,导致压缩误差及次优率失真权衡。本文提出一种端到端视频压缩方法,包含多个关键模块:设计一种带有残差跳连的自编码器网络,高效压缩运动信息;构建运动矢量与残差帧滤波网络,减轻系统压缩误差;利用PReLU等强非线性变换深化运动补偿架构;引入缓冲区微调前参考帧,提升重建帧质量。各模块结合精心设计的损失函数,评估率失真权衡并优化解码输出整体质量。实验在HEVC(序列B、C、D)、UVG、VTL和MCL-JCV等多个数据集上验证了该方法的竞争力,有效解决运动估计与补偿挑战,性能优于现有方法。
原文摘要 · Abstract (English)
Existing learning-based video compression methods still face challenges related to inaccurate motion estimates and inadequate motion compensation structures. These issues result in compression errors and a suboptimal rate-distortion trade-off. To address these challenges, this work presents an end-to-end video compression method that incorporates several key operations. Specifically, we propose an autoencoder-type network with a residual skip connection to efficiently compress motion information. Additionally, we design motion vector and residual frame filtering networks to mitigate compression errors in the video compression system. To improve the effectiveness of the motion compensation network, we utilize powerful nonlinear transforms, such as the Parametric Rectified Linear Unit (PReLU), to delve deeper into the motion compensation architecture. Furthermore, a buffer is introduced to fine-tune the previous reference frames, thereby enhancing the reconstructed frame quality. These modules are combined with a carefully designed loss function that assesses the trade-off and enhances the overall video quality of the decoded output. Experimental results showcase the competitive performance of our method on various datasets, including HEVC (sequences B, C, and D), UVG, VTL, and MCL-JCV. The proposed approach tackles the challenges of accurate motion estimation and motion compensation in video compression, and the results highlight its competitive performance compared to existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。