arXiv:2509.22323cs.CV2025-09被引 6

提出三层次加速策略,让扩散Transformer生成图像快近3倍且无需重训练。

RAPID^3: Tri-Level Reinforced Acceleration Policies for Diffusion Transformer

  • 三个轻量策略头按每步状态自主决定跳步、缓存复用和稀疏注意力。
  • 在Stable Diffusion 3和FLUX上实现接近3倍加速,质量与原模型相当。
  • 无需更新主模型,适合快速部署到各类扩散生成系统。

扩散Transformer(DiT)在视觉生成中表现优异,但采样速度缓慢。现有无训练加速方法——步数减少、特征缓存、稀疏注意力——通常依赖统一启发式或手动设计的自适应策略,难以兼顾所有图像的质量。动态神经网络虽可实现逐图自适应加速,但微调成本高,适用范围受限。为此,本文提出RAPID³:三层次强化加速策略,实现对扩散变压器的图像级加速且无需更新基础生成器。具体而言,三个轻量级策略头——跳步、缓存复用、稀疏注意力——根据当前去噪状态,在每一步独立决策加速方式。所有策略参数通过在线群组相对策略优化(GRPO)训练,而生成器保持冻结。同时,对抗性学习的判别器增强奖励信号,仅在生成样本接近原模型分布时提升回报,防止奖励劫持。在多个主流DiT骨干网络(包括Stable Diffusion 3和FLUX)上,RAPID³实现了近3倍的采样加速,同时保持竞争力的生成质量。

原文摘要 · Abstract (English)

Diffusion Transformers (DiTs) excel at visual generation yet remain hampered by slow sampling. Existing training-free accelerators - step reduction, feature caching, and sparse attention - enhance inference speed but typically rely on a uniform heuristic or a manually designed adaptive strategy for all images, leaving quality on the table. Alternatively, dynamic neural networks offer per-image adaptive acceleration, but their high fine-tuning costs limit broader applicability. To address these limitations, we introduce RAPID3: Tri-Level Reinforced Acceleration Policies for Diffusion Transformers, a framework that delivers image-wise acceleration with zero updates to the base generator. Specifically, three lightweight policy heads - Step-Skip, Cache-Reuse, and Sparse-Attention - observe the current denoising state and independently decide their corresponding speed-up at each timestep. All policy parameters are trained online via Group Relative Policy Optimization (GRPO) while the generator remains frozen. Meanwhile, an adversarially learned discriminator augments the reward signal, discouraging reward hacking by boosting returns only when generated samples stay close to the original model's distribution. Across state-of-the-art DiT backbones, including Stable Diffusion 3 and FLUX, RAPID3 achieves nearly 3x faster sampling with competitive generation quality.

扩散模型加速生成强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。