arXiv:2607.04461cs.CV2026-07被引 1

通过快速生成候选图稿,显著提升扩散模型推理效率。

Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models

论文配图:Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models
图 1 · 摘自论文原文
  • 用三重加速技术批量生成低成本草稿,再精选优化。
  • 在固定时间预算下,比现有方法平均提升8%性能,大模型更明显。
  • 适合追求高效推理的开发者,尤其适配大规模扩散模型。

文本到图像生成的推理时扩展已从简单的Best-of-N(BoN)采样发展到在去噪中间步骤验证并引导候选轨迹的引导搜索方法。这些方法关注何时以及多频繁地进行验证,但大多将生成成本视为固定值。此外,以函数评估次数(NFE)衡量方法的标准仅计算去噪前向传播,忽略了验证器开销,可能导致效率排名失真。我们发现,在实际运行时间评估下,简单BoN已能匹配甚至超越多个引导搜索技术,表明计算资源更应投入于广泛探索而非重复中间验证。这促使我们提出Flash-BoN,通过结合三种互补的加速手段——时间步截断、层跳过和激活代理——形成单一配置,一次性为每种模型优化。随后采用高效的多阶段验证流程,选出最有潜力的草稿并以全质量精细处理。在三个基准测试和三种模型规模下,Flash-BoN在固定墙钟时间预算下始终优于所有基线,增益随模型规模增大而提升(+8% AUC)。我们还证明该策略可与基于反射的提示优化等独立技术协同,进一步提升16% AUC。性能提升与候选多样性增加相关,也使草稿引导选择加速强化学习后训练的收敛。

原文摘要 · Abstract (English)

Inference-time scaling for text-to-image generation has progressed from simple Best-of-$N$ (BoN) sampling to guided search methods that verify and steer candidate trajectories at intermediate denoising steps. These approaches focus on when and how often to verify during denoising but largely treat the cost of generation itself as fixed. Moreover, the standard practice of comparing methods by number of function evaluations (NFEs) counts only denoising forward passes and ignores verifier overhead, which can distort efficiency rankings. We show that under wall-clock evaluation, simple BoN already matches or outperforms several guided search techniques, suggesting that compute is better spent on broader exploration than on repeated intermediate verification. This motivates Flash-BoN, which generates a large pool of inexpensive draft candidates by combining three complementary acceleration knobs: timestep truncation, layer skipping, and activation proxies into a single configuration optimized once per model. An efficient multi-stage verification procedure then identifies the most promising draft, which is refined at full quality. Across three benchmarks and three model scales, Flash-BoN consistently outperforms all baselines under fixed wall-clock budgets, with gains that grow at larger model scales (+8% AUC). We further show that our strategy combines well and improves existing orthogonal techniques such as reflection-based prompt optimization (+16% AUC). The gains correlate with increased candidate diversity, which also enables draft-guided selection to accelerate RL post-training convergence.

扩散模型推理加速高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。