arXiv:2603.05756eess.IVcs.CV2026-03被引 2

统一视频压缩模型,支持单模型内/外帧编码,提升可靠性。

Uni-LVC: A Unified Method for Intra- and Inter-Mode Learned Video Compression

  • 将帧间编码转为条件帧内编码,用时序信息驱动
  • 在多种模式下均超越现有方法,保持高效计算
  • 适合需要灵活编码的低延迟与随机访问场景

近期学习型视频压缩(LVC)取得显著进展,如DCVC-RT在压缩效率上已超越H.266/VVC低延迟模式。然而现有LVC仍存在关键缺陷:通常需分别建模帧内与帧间编码,且当时间参考不可靠时性能下降。为此,本文提出Uni-LVC,一种支持单模型内/外编码、兼顾低延迟与随机访问的统一方法。基于强健的帧内编码器,Uni-LVC将帧间编码建模为依赖参考帧时序信息的条件帧内编码。设计高效的交叉注意力适配模块融合时序线索,实现单模型对单向(低延迟)与双向(随机访问)预测模式的无缝支持。引入可靠性感知分类器,动态缩放时序线索,在参考不可靠时使模型行为更接近帧内编码。进一步提出多阶段训练策略,促进跨编码模式的自适应学习。大量实验表明,Uni-LVC在帧内与帧间配置下均取得更优率失真性能,同时保持相近的计算效率。

原文摘要 · Abstract (English)

Recent advances in learned video compression (LVC) have led to significant performance gains, with codecs such as DCVC-RT surpassing the H.266/VVC low-delay mode in compression efficiency. However, existing LVCs still exhibit key limitations: they often require separate models for intra and inter coding modes, and their performance degrades when temporal references are unreliable. To address this, we introduce Uni-LVC, a unified LVC method that supports both intra and inter coding with low-delay and random-access in a single model. Building on a strong intra-codec, Uni-LVC formulates inter-coding as intra-coding conditioned on temporal information extracted from reference frames. We design an efficient cross-attention adaptation module that integrates temporal cues, enabling seamless support for both unidirectional (low-delay) and bidirectional (random-access) prediction modes. A reliability-aware classifier is proposed to selectively scale the temporal cues, making Uni-LVC behave closer to intra coding when references are unreliable. We further propose a multistage training strategy to facilitate adaptive learning across various coding modes. Extensive experiments demonstrate that Uni-LVC achieves superior rate-distortion performance in intra and inter configurations while maintaining comparable computational efficiency.

视频压缩统一模型学习编码时序融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。