arXiv:2601.19488cs.CV2026-01

针对长时视频生成,提出动态采样策略以提升质量与稳定性。

Entropy-Guided k-Guard Sampling for Long-Horizon Autoregressive Video Generation

  • 根据每个帧的预测熵动态调整候选词数量,低熵区少选、高熵区多选。
  • 在多个数据集上相比固定k/p策略,显著提升视频清晰度和结构一致性。
  • 无需训练、不依赖模型,适合各类自回归视频生成系统使用。

自回归架构在大语言模型中取得巨大成功,推动了视频生成的研究。然而,语言标记具有高语义密度和低冗余性,而视频标记则语义密度低、时空冗余高。这导致固定的top-k/top-p采样策略在视频解码器中表现不佳:对低不确定性区域(如静态背景)引入过多随机性,对高不确定性区域(如前景物体)则易陷入早期错误。预测误差随帧数累积,严重损害长时视频质量。为此,本文提出熵引导的k-守护(ENkG)采样策略,通过量化每个标记预测分布的熵,自适应调整候选集大小。在低熵区域采用较少候选以抑制冗余噪声并保持结构完整;在高熵区域采用更多候选以缓解误差累积。ENkG为模型无关、无需训练,计算开销极小。实验表明,其在感知质量和结构稳定性方面均优于静态top-k/top-p策略。

原文摘要 · Abstract (English)

Autoregressive (AR) architectures have achieved significant successes in LLMs, inspiring explorations for video generation. In LLMs, top-p/top-k sampling strategies work exceptionally well: language tokens have high semantic density and low redundancy, so a fixed size of token candidates already strikes a balance between semantic accuracy and generation diversity. In contrast, video tokens have low semantic density and high spatio-temporal redundancy. This mismatch makes static top-k/top-p strategies ineffective for video decoders: they either introduce unnecessary randomness for low-uncertainty regions (static backgrounds) or get stuck in early errors for high-uncertainty regions (foreground objects). Prediction errors will accumulate as more frames are generated and eventually severely degrade long-horizon quality. To address this, we propose Entropy-Guided k-Guard (ENkG) sampling, a simple yet effective strategy that adapts sampling to token-wise dispersion, quantified by the entropy of each token's predicted distribution. ENkG uses adaptive token candidate sizes: for low-entropy regions, it employs fewer candidates to suppress redundant noise and preserve structural integrity; for high-entropy regions, it uses more candidates to mitigate error compounding. ENkG is model-agnostic, training-free, and adds negligible overhead. Experiments demonstrate consistent improvements in perceptual quality and structural stability compared to static top-k/top-p strategies.

视频生成自回归采样策略熵引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。