arXiv:2605.21072cs.CV2026-05

提出新量化框架,让自回归视频生成模型更高效

Q-ARVD: Quantizing Autoregressive Video Diffusion Models

论文配图:Q-ARVD: Quantizing Autoregressive Video Diffusion Models
图 1 · 摘自论文原文
  • 引入帧级加权机制,解决生成中误差累积导致的敏感度失衡
  • 设计异常值感知双尺度量化,保护不同层的异常通道不被干扰
  • 适用于需实时交互的视频生成场景,显著提升推理效率

自回归视频扩散模型(ARVD)是实现流式视频生成和实时交互的重要架构,但其高昂的推理成本限制了实际应用。尽管模型量化是提升效率的自然方向,现有针对标准扩散模型的量化方法在ARVD上表现不佳,因二者存在显著差异。本文发现两大挑战:(C1) 帧间量化敏感度严重失衡,误差累积导致敏感度呈指数衰减;(C2) 权重分布中存在显著且异构的异常值通道,其模式随层数与块深度变化。为此,我们提出Q-ARVD框架:(S1) 在量化目标中引入终帧质量感知的帧权重机制以缓解敏感度失衡;(S2) 设计异常值感知的自适应双尺度量化,自动检测并隔离异常通道,保护正常通道。大量实验验证了该方法的优越性。

原文摘要 · Abstract (English)

Autoregressive video diffusion models (ARVDs) have emerged as a promising architecture for streaming video generation, paving the way for real-time interactive video generation and world modeling. Despite their potential, the substantial inference cost of ARVDs remains a major obstacle to practical deployment, making model quantization a natural direction for improving efficiency. However, quantization for ARVDs remains largely unexplored. Our empirical analysis shows that directly applying existing quantization schemes developed for standard diffusion transformers to ARVDs leads to suboptimal performance, revealing quantization behaviors that differ from those observed in bidirectional diffusion models. In this paper, we identify two critical challenges in quantizing ARVDs: (C1) Highly unbalanced frame-wise quantization sensitivity. Error accumulation during autoregressive generation can induce severely skewed quantization sensitivity across frames, following an exponential-like decay pattern. (C2) Prominent and heterogeneous outlier patterns in weights. Weight distributions exhibit pronounced outlier channels, whose patterns vary substantially across layer types and block depths. To address these issues, we propose Q-ARVD, a novel framework for accurate ARVD quantization. (S1) To tackle the highly unbalanced frame-wise sensitivity, Q-ARVD incorporates a final-quality aware frame-weighting mechanism into the quantization objective. (S2) To prevent heterogeneous outliers from degrading performance, Q-ARVD introduces an outlier-aware adaptive dual-scale quantization, which automatically detects the presence and quantity of outlier channels for an arbitrary layer, and isolates them to protect normal channels. Extensive experiments demonstrate the superiority of Q-ARVD.

视频生成扩散模型量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。