arXiv:2512.11293cs.CV2025-12被引 1

分离时空信息,用自回归方式高效压缩视频。

Autoregressive Video Autoencoder with Decoupled Temporal and Spatial Context

  • 自回归编码解码,逐帧依赖前一帧重建
  • 时空解耦表示,压缩率高且无信息损失
  • 轻量模型+小数据训练,适合视频生成应用

视频自编码器通过将视频压缩为紧凑的潜在表示来提升生成效率与质量。然而,现有方法常混淆时空信息,难以保证时间一致性。为此,我们提出自回归视频自编码器(ARVAE),以自回归方式逐帧压缩与重建,支持任意长度视频处理。ARVAE采用时空解耦表示:利用下采样光流场保持时间连贯性,结合空间相对补偿捕捉新出现内容,实现高效率压缩且不丢失信息。编码器将当前帧与前一帧压缩为运动与补充特征,解码器基于前一帧和潜变量重建原帧。采用多阶段训练策略逐步优化。大量实验表明,ARVAE在极轻量模型和小规模数据下仍具备优越重建质量;在视频生成任务中表现优异,展现出强下游应用潜力。

原文摘要 · Abstract (English)

Video autoencoders compress videos into compact latent representations for efficient reconstruction, playing a vital role in enhancing the quality and efficiency of video generation. However, existing video autoencoders often entangle spatial and temporal information, limiting their ability to capture temporal consistency and leading to suboptimal performance. To address this, we propose Autoregressive Video Autoencoder (ARVAE), which compresses and reconstructs each frame conditioned on its predecessor in an autoregressive manner, allowing flexible processing of videos with arbitrary lengths. ARVAE introduces a temporal-spatial decoupled representation that combines downsampled flow field for temporal coherence with spatial relative compensation for newly emerged content, achieving high compression efficiency without information loss. Specifically, the encoder compresses the current and previous frames into the temporal motion and spatial supplement, while the decoder reconstructs the original frame from the latent representations given the preceding frame. A multi-stage training strategy is employed to progressively optimize the model. Extensive experiments demonstrate that ARVAE achieves superior reconstruction quality with extremely lightweight models and small-scale training data. Moreover, evaluations on video generation tasks highlight its strong potential for downstream applications.

视频生成自回归时空解耦压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。