arXiv:2507.06739cs.CV2025-07被引 1

根据提示词复杂度动态调整缓存阈值,提升视频生成速度与质量。

PromptTea: Let Prompts Tell TeaCache the Optimal Threshold

  • 基于输入提示词的语义信息估算场景复杂度,自适应调节缓存频率。
  • 在Wan2.1模型上实现2.79倍加速,保持高质量输出。
  • 适合需要高效生成高复杂度视频的研究者与开发者。

尽管视频生成技术取得进展,推理速度仍是主要瓶颈。现有加速策略常通过固定间隔缓存模型输出,但该方法在复杂场景中显著降低质量,而手动调参效率低且不稳定。为此,我们提出提示词复杂度感知(PCA)缓存机制,基于输入提示词直接估算场景复杂度,实现更智能的缓存决策。我们重新审视TeaCache假设,发现其因简化先验导致输入-输出关系建模不足;为此,解耦噪声输入,增强文本信息贡献,并通过多元多项式特征扩展提升预测精度。为降低计算开销,将静态CFGCache替换为动态的DynCFGCache,根据输出变化估计选择性重用分类器无关引导(CFG)输出,实现灵活缓存且不牺牲质量。大量实验表明,本方法在多种场景下显著加速——如在Wan2.1模型上达2.79倍提速——同时保持高视觉保真度。

原文摘要 · Abstract (English)

Despite recent progress in video generation, inference speed remains a major bottleneck. A common acceleration strategy involves reusing model outputs via caching mechanisms at fixed intervals. However, we find that such fixed-frequency reuse significantly degrades quality in complex scenes, while manually tuning reuse thresholds is inefficient and lacks robustness. To address this, we propose Prompt-Complexity-Aware (PCA) caching, a method that automatically adjusts reuse thresholds based on scene complexity estimated directly from the input prompt. By incorporating prompt-derived semantic cues, PCA enables more adaptive and informed reuse decisions than conventional caching methods. We also revisit the assumptions behind TeaCache and identify a key limitation: it suffers from poor input-output relationship modeling due to an oversimplified prior. To overcome this, we decouple the noisy input, enhance the contribution of meaningful textual information, and improve the model's predictive accuracy through multivariate polynomial feature expansion. To further reduce computational cost, we replace the static CFGCache with DynCFGCache, a dynamic mechanism that selectively reuses classifier-free guidance (CFG) outputs based on estimated output variations. This allows for more flexible reuse without compromising output quality. Extensive experiments demonstrate that our approach achieves significant acceleration-for example, 2.79x speedup on the Wan2.1 model-while maintaining high visual fidelity across a range of scenes.

视频生成缓存优化扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。