arXiv:2511.16156cs.CV2025-11中稿 · CVPR被引 6

提出可插拔剪枝框架,让扩散模型变小30%以上仍保高质量。

Pluggable Pruning with Contiguous Layer Distillation for Diffusion Transformers

  • 通过分析层间相似性,自动识别可剪枝冗余层段。
  • 单次训练实现深度与宽度联合剪枝,参数量减少50%。
  • 无需重训,适合部署在算力有限的设备上。

扩散变换器(DiTs)在图像生成中表现优异,但参数量大导致计算开销高,难以在资源受限场景部署。为此,本文提出可插拔剪枝与连续层蒸馏框架(PPCL),专为DiT架构设计。首先,利用线性探测结合相似性度量的一阶微分趋势分析,识别冗余层区间;随后提出一种即插即用的师生交替蒸馏机制,可在单一训练阶段同时实现深度与宽度剪枝,支持灵活压缩比,避免针对不同剪枝率重复训练。在多个多模态扩散变换器模型上的实验表明,相比完整模型,PPCL实现50%参数量削减,关键指标下降不足3%,且保持高质量图像生成能力,显著提升压缩效率,适用于资源受限环境。开源代码与模型权重见:https://github.com/OPPO-Mente-Lab/Qwen-Image-Pruning。

原文摘要 · Abstract (English)

Diffusion Transformers (DiTs) have shown exceptional performance in image generation, yet their large parameter counts incur high computational costs, impeding deployment in resource-constrained settings. To address this, we propose Pluggable Pruning with Contiguous Layer Distillation (PPCL), a flexible structured pruning framework specifically designed for DiT architectures. First, we identify redundant layer intervals through a linear probing mechanism combined with the first-order differential trend analysis of similarity metrics. Subsequently, we propose a plug-and-play teacher-student alternating distillation scheme tailored to integrate depth-wise and width-wise pruning within a single training phase. This distillation framework enables flexible knowledge transfer across diverse pruning ratios, eliminating the need for per-configuration retraining. Extensive experiments on multiple Multi-Modal Diffusion Transformer architecture models demonstrate that PPCL achieves a 50\% reduction in parameter count compared to the full model, with less than 3\% degradation in key objective metrics. Notably, our method maintains high-quality image generation capabilities while achieving higher compression ratios, rendering it well-suited for resource-constrained environments. The open-source code, checkpoints for PPCL can be found at the following link: https://github.com/OPPO-Mente-Lab/Qwen-Image-Pruning.

扩散模型模型剪枝轻量化蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。