arXiv:2511.21122cs.CVcs.AI2025-11

通过熵引导动态剪枝,让生成模型更快更省资源。

Which Layer Causes Distribution Deviation? Entropy-Guided Adaptive Pruning for Diffusion and Flow Models

  • 用条件熵偏差衡量模块重要性,精准识别可剪枝层。
  • 实现2.22倍推理加速,生成质量仍保持竞争力。
  • 适合需要高效部署生成模型的研究与开发者。

大规模视觉生成模型(如扩散模型和流模型)在图像生成任务中表现优异,但迁移到下游任务时常出现参数冗余。本文提出EntPruner,一种面向扩散与流模型的熵引导自适应渐进式剪枝框架。首先,设计块级重要性评估策略——熵引导剪枝,针对生成模型需保留输出分布多样性和条件一致性特点,利用数据依赖的条件熵偏差(CED)作为剪枝指标,量化移除某模块后输出分布偏离原始条件分布的程度。其次,提出零样本自适应剪枝框架,动态决定剪枝时机与幅度,避免一次性剪枝导致的模式崩溃,保障性能。在DiT与SiT模型上的大量实验表明,EntPruner可实现最高达2.22倍的推理速度提升,同时在ImageNet及三个下游数据集上保持良好生成质量。

原文摘要 · Abstract (English)

Large-scale vision generative models, including diffusion and flow models, have demonstrated remarkable performance in visual generation tasks. However, transferring these pre-trained models to downstream tasks often results in significant parameter redundancy. In this paper, we propose EntPruner, an entropy-guided automatic progressive pruning framework for diffusion and flow models. First, we introduce entropy-guided pruning, a block-level importance assessment strategy specifically designed for generative models. Unlike discriminative models, generative models require preserving the diversity and condition-fidelity of the output distribution. As the importance of each module can vary significantly across downstream tasks, EntPruner prioritizes pruning of less important blocks using data-dependent Conditional Entropy Deviation (CED) as a guiding metric. CED quantifies how much the distribution diverges from the learned conditional data distribution after removing a block. Second, we propose a zero-shot adaptive pruning framework to automatically determine when and how much to prune during training. This dynamic strategy avoids the pitfalls of one-shot pruning, mitigating mode collapse, and preserving model performance. Extensive experiments on DiT and SiT models demonstrate the effectiveness of EntPruner, achieving up to 2.22$\times$ inference speedup while maintaining competitive generation quality on ImageNet and three downstream datasets.

生成模型剪枝扩散模型效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。