提出并行扩散求解器EPD-Solver,加速采样同时保持高质量生成。
Parallel Diffusion Solver via Residual Dirichlet Policy Optimization
- 通过多路径梯度并行计算,更精准逼近轨迹积分。
- 在低延迟下生成图像质量优于现有方法,尤其在复杂文本到图像任务中。
- 可作为插件提升现有求解器性能,适合追求高效生成的开发者。
扩散模型虽具顶尖生成性能,但因逐次去噪导致采样延迟高。现有基于求解器的加速方法常在低延迟预算下显著降低图像质量,主因是难以捕捉高曲率轨迹段,引发累积截断误差。本文提出集成并行方向求解器(EPD-Solver),通过每步引入多个并行梯度评估,缓解此类误差。受采样轨迹集中在低维流形的几何启发,利用向量值函数的均值定理实现更精确的积分近似。由于额外梯度计算相互独立,可完全并行化,保持低延迟特性。我们设计两阶段优化框架:首先通过基于蒸馏的方法优化少量可学习参数;进一步提出一种参数高效的强化学习微调方案,将求解器重构成随机狄利克雷策略。相比传统微调庞大主干模型,该方法仅在低维求解器空间内操作,有效防止奖励滥用,提升复杂文本到图像生成性能。此外,本方法具有灵活性,可作为插件(EPD-Plugin)无缝增强现有ODE采样器。
原文摘要 · Abstract (English)
Diffusion models (DMs) have achieved state-of-the-art generative performance but suffer from high sampling latency due to their sequential denoising nature. Existing solver-based acceleration methods often face significant image quality degradation under a low-latency budget, primarily due to accumulated truncation errors arising from the inability to capture high-curvature trajectory segments. In this paper, we propose the Ensemble Parallel Direction solver (dubbed as EPD-Solver), a novel ODE solver that mitigates these errors by incorporating multiple parallel gradient evaluations in each step. Motivated by the geometric insight that sampling trajectories are largely confined to a low-dimensional manifold, EPD-Solver leverages the Mean Value Theorem for vector-valued functions to approximate the integral solution more accurately. Importantly, since the additional gradient computations are independent, they can be fully parallelized, preserving low-latency sampling nature. We introduce a two-stage optimization framework. Initially, EPD-Solver optimizes a small set of learnable parameters via a distillation-based approach. We further propose a parameter-efficient Reinforcement Learning (RL) fine-tuning scheme that reformulates the solver as a stochastic Dirichlet policy. Unlike traditional methods that fine-tune the massive backbone, our RL approach operates strictly within the low-dimensional solver space, effectively mitigating reward hacking while enhancing performance in complex text-to-image (T2I) generation tasks. In addition, our method is flexible and can serve as a plugin (EPD-Plugin) to improve existing ODE samplers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。