arXiv:2508.17356cs.CV2025-08被引 31

让扩散模型自己决定缓存时机和方式,提升生成效率与质量。

DiCache: Let Diffusion Model Determine Its Own Cache

  • 基于浅层特征动态判断何时缓存,实现样本自适应。
  • 缓存误差实时监控,多步缓存结果逼近深层输出。
  • 无需训练,适配多种扩散模型,提升视觉质量。

近年来,扩散模型的加速技术迅速发展,尤其是基于缓存的方法。现有方法通常依赖预设经验规则或数据集先验来决定缓存时机和使用策略,但在高度动态的扩散过程中泛化能力有限,难以应对多样化样本。本文发现,扩散模型浅层特征差异变化模式与深层特征具有强样本相关性,且各层特征轨迹相似。基于此,提出DiCache:一种无需训练的运行时自适应缓存策略,统一解决‘何时缓存’与‘如何使用缓存’问题。其包含两个核心组件:(1) 在线探针分析方案,通过浅层在线探针实时获取缓存误差指标,动态定制每张样本的缓存调度;(2) 动态缓存轨迹对齐,根据浅层特征轨迹自适应逼近多步历史缓存的深层输出,提升图像质量。大量实验表明,DiCache在WAN 2.1、HunyuanVideo和Flux等主流扩散模型上均显著优于当前最优方法,兼具更高效率与更优保真度。

原文摘要 · Abstract (English)

Recent years have witnessed the rapid development of acceleration techniques for diffusion models, especially caching-based acceleration methods. These studies seek to answer two fundamental questions: "When to cache" and "How to use cache", typically relying on predefined empirical laws or dataset-level priors to determine caching timings and adopting handcrafted rules for multi-step cache utilization. However, given the highly dynamic nature of the diffusion process, they often exhibit limited generalizability and fail to cope with diverse samples. In this paper, a strong sample-specific correlation is revealed between the variation patterns of the shallow-layer feature differences in the diffusion model and those of deep-layer features. Moreover, we have observed that the features from different model layers form similar trajectories. Based on these observations, we present DiCache, a novel training-free adaptive caching strategy for accelerating diffusion models at runtime, answering both when and how to cache within a unified framework. Specifically, DiCache is composed of two principal components: (1) Online Probe Profiling Scheme leverages a shallow-layer online probe to obtain an on-the-fly indicator for the caching error in real time, enabling the model to dynamically customize the caching schedule for each sample. (2) Dynamic Cache Trajectory Alignment adaptively approximates the deep-layer feature output from multi-step historical caches based on the shallow-layer feature trajectory, facilitating higher visual quality. Extensive experiments validate DiCache's capability in achieving higher efficiency and improved fidelity over state-of-the-art approaches on various leading diffusion models including WAN 2.1, HunyuanVideo and Flux.

扩散模型缓存加速自适应视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。