arXiv:2510.09987eess.IVcs.CV2025-10被引 9

用生成式隐空间压缩视频,解决模糊闪烁问题。

Generative Latent Video Compression

  • 先将视频转为感知对齐的隐空间,再压缩,分离感知与码率优化。
  • 在DISTS/LPIPS指标上达到最新水平,速率仅需对手一半。
  • 适合追求高感知质量且要稳定时序的视频压缩场景。

感知优化在神经压缩中至关重要,但速率-失真-感知三者平衡仍具挑战,尤其在视频压缩中,帧间质量波动常导致视觉闪烁。本文受生成式隐空间模型启发,提出生成式隐空间视频压缩(GLVC)框架。该方法利用预训练连续分词器将视频帧映射至感知对齐的隐空间,从而将感知约束从速率-失真优化中解耦。我们重新设计了专用于隐空间的编码器结构,借鉴前人神经视频编码经验,并引入统一内/外预测编码与循环记忆机制。多基准测试结果表明,GLVC在DISTS和LPIPS指标上均达当前最优。用户研究表明,在几乎仅为现有先进神经视频编码器一半码率下,其仍保持优异的时序稳定性,标志着向实用化感知视频压缩迈进一步。

原文摘要 · Abstract (English)

Perceptual optimization is widely recognized as essential for neural compression, yet balancing the rate-distortion-perception tradeoff remains challenging. This difficulty is especially pronounced in video compression, where frame-wise quality fluctuations often cause perceptually optimized neural video codecs to suffer from flickering artifacts. In this paper, inspired by the success of latent generative models, we present Generative Latent Video Compression (GLVC), an effective framework for perceptual video compression. GLVC employs a pretrained continuous tokenizer to project video frames into a perceptually aligned latent space, thereby offloading perceptual constraints from the rate-distortion optimization. We redesign the codec architecture explicitly for the latent domain, drawing on extensive insights from prior neural video codecs, and further equip it with innovations such as unified intra/inter coding and a recurrent memory mechanism. Experimental results across multiple benchmarks show that GLVC achieves state-of-the-art performance in terms of DISTS and LPIPS metrics. Notably, our user study confirms GLVC rivals the latest neural video codecs at nearly half their rate while maintaining stable temporal coherence, marking a step toward practical perceptual video compression.

视频压缩生成模型感知优化隐空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。