arXiv:2510.27171cs.CVcs.AI2025-10被引 1

提出分阶段缓存机制,让生成模型提速5倍同时保持画质。

H2-Cache: A Novel Hierarchical Dual-Stage Cache for High-Performance Acceleration of Generative Diffusion Models

  • 将去噪分为结构与细节两阶段,分别用阈值缓存。
  • 在Flux模型上实现最高5.08倍加速,画质几乎无损。
  • 适合追求高效高质图像生成的开发者和研究者。

扩散模型在图像生成中已达顶尖水平,但其迭代去噪过程带来显著计算开销,制约实际部署。现有缓存技术常在速度与质量间权衡,导致画质下降和高计算负担。为此,本文提出H2-Cache,一种针对现代生成扩散模型架构的新型分层双阶段缓存机制。核心洞察是去噪过程可功能分离为结构定义与细节精修两个阶段。H2-Cache采用双阈值系统,对各阶段独立选择性缓存。为保障双重检查效率,引入轻量级特征摘要(PFS)技术,实现快速且鲁棒的相似性估计。在Flux架构上的大量实验表明,H2-Cache实现最高5.08倍加速,画质与基线近乎一致,在定量与定性评估上均优于现有方法。本工作提供了一种稳健实用的解决方案,有效化解速度-质量矛盾,显著降低高质量扩散模型的实际应用门槛。源代码见:https://github.com/Bluear7878/H2-cache-A-Hierarchical-Dual-Stage-Cache。

原文摘要 · Abstract (English)

Diffusion models have emerged as state-of-the-art in image generation, but their practical deployment is hindered by the significant computational cost of their iterative denoising process. While existing caching techniques can accelerate inference, they often create a challenging trade-off between speed and fidelity, suffering from quality degradation and high computational overhead. To address these limitations, we introduce H2-Cache, a novel hierarchical caching mechanism designed for modern generative diffusion model architectures. Our method is founded on the key insight that the denoising process can be functionally separated into a structure-defining stage and a detail-refining stage. H2-cache leverages this by employing a dual-threshold system, using independent thresholds to selectively cache each stage. To ensure the efficiency of our dual-check approach, we introduce pooled feature summarization (PFS), a lightweight technique for robust and fast similarity estimation. Extensive experiments on the Flux architecture demonstrate that H2-cache achieves significant acceleration (up to 5.08x) while maintaining image quality nearly identical to the baseline, quantitatively and qualitatively outperforming existing caching methods. Our work presents a robust and practical solution that effectively resolves the speed-quality dilemma, significantly lowering the barrier for the real-world application of high-fidelity diffusion models. Source code is available at https://github.com/Bluear7878/H2-cache-A-Hierarchical-Dual-Stage-Cache.

扩散模型缓存优化图像生成加速推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。