双向视频压缩新框架,解码速度提升30倍且压缩更优
BiCRVC: An Efficient Bidirectional Neural Video Compression Framework via Coupled Representation Coding

- 运动与帧信息融合编码,统一使用一个解码器
- 多候选运动估计提升长距离运动精度,减少编码开销
- 适合需要快速随机访问的实时视频应用
神经视频压缩(NVC)已取得优异压缩性能,但实际随机访问编码仍面临两大挑战:现有双向NVC(BVC)通常需高成本的运动优先解码,且在长距离双向预测下难以实现可靠运动估计。为此,本文提出BiCRVC,一种基于耦合表示编码的高效双向神经视频压缩框架。该框架将运动表示与当前帧隐含表示转换为统一的隐含表示进行熵编码,使运动与帧信息可从同一比特流中解码,同时重建对齐的运动上下文用于帧重构。为提升运动准确性,引入多候选运动估计(MCME),结合多尺度运动估计与并行累积运动估计以应对多样且长距离的运动。为降低运动编码开销,进一步提出双向运动特征传播(BMFP),在编码器和解码器端复用先前解码的运动特征作为时序先验,实现条件化运动编码。此外,采用耦合失真训练与随机GOP结构训练,促进运动-帧联合编码,并增强对分层随机访问结构的适应性。实验表明,BiCRVC在压缩性能上优于当前最先进BVC方法,同时1080p解码速度比近期BVC快约30倍。
原文摘要 · Abstract (English)
Neural video compression (NVC) has achieved strong compression performance, but practical random-access coding still faces two technical challenges: existing bidirectional NVCs (BVCs) usually require costly motion-first decoding, and reliable motion estimation is difficult under long-range bidirectional prediction. To address these issues, we present BiCRVC, an efficient bidirectional neural video compression framework based on coupled representation coding. Instead of coding motion and frame information with two separate codecs, BiCRVC transforms the motion representation and the current-frame latent into a unified latent representation for entropy coding. This design enables motion and frame information to be decoded from the same bitstream with one unified codec, while still reconstructing motion-aligned contexts for frame decoding. To improve motion accuracy, we introduce multi-candidate motion estimation (MCME), which combines multi-scale motion estimation and parallel accumulated motion estimation to better handle diverse and long-range motions. To reduce motion coding overhead, we further propose bidirectional motion feature propagation (BMFP), which reuses previously decoded motion features at both the encoder and decoder as temporal priors for conditional motion coding. In addition, coupled distortion training and random GOP structure training are used to encourage joint motion-frame coding and improve adaptation to hierarchical random-access structures. Experiments show that BiCRVC achieves better compression performance than state-of-the-art BVCs while providing about 30 times faster 1080p decoding than recent BVCs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。