通过智能回溯与探索,让扩散模型生成更高质量的图像。
Ctrl-Z Sampling: Scaling Diffusion Sampling with Controlled Random Zigzag Explorations
- 发现生成过程易卡在低质量局部最优,提出动态探测并回溯
- 在不同计算预算下,显著提升生成质量,优于现有方法
- 无需修改模型,兼容主流扩散框架,适合追求高质量输出者
扩散模型通过逐步去噪高斯噪声生成条件样本,但去噪轨迹可能停滞在视觉上合理却质量低下、存在结构偏差的结果。我们将此现象视为代理质量景观中的局部最优:早期去噪一旦选定次优全局结构,后续步骤仅聚焦细节优化,难以纠正根本错误。现有推理时方法通过固定强度或方向重去噪探索替代路径,但难以摆脱陡峭的质量平台。我们提出可控随机锯齿采样(Ctrl-Z Sampling),利用代理梯度探测质量平台,仅在检测到平台时启动探索。检测后,模型回退至更嘈杂状态,采样多组替代延续路径,若候选路径改善分数则更新轨迹,否则加深探索以逃离当前平台。该方法与模型无关,广泛兼容现有扩散框架。实验表明,在不同非平凡估计步数(NFE)预算下,其生成质量持续优于其他推理时缩放采样器,提供可扩展的计算-质量权衡。代码已开源。
原文摘要 · Abstract (English)
Diffusion models generate conditional samples by progressively denoising Gaussian noise, yet the denoising trajectory can stall at visually plausible but low-quality outcomes with conditional misalignment or structural artifacts. We interpret this behavior as local optima in a surrogate quality landscape: Once early denoising commits to a suboptimal global structure, later steps mainly sharpen details and seldom correct the underlying mistake. While existing inference-time approaches explore alternative diffusion states via re-noising with fixed strength or direction, they exhibit limited capacity to escape steep quality plateaus. We propose Controlled Random Zigzag Sampling (Ctrl-Z Sampling),a scalable sampling strategy that detects plateaus in quality landscape via a surrogate score, and allocates exploration only when a plateau is detected. Upon detection, Ctrl-Z Sampling rolls back to noisier states, samples a set of alternative continuations, and updates the trajectory when a candidate improves the score, otherwise escalating the exploration depth to escape the current plateau. The proposed method is model-agnostic and broadly compatible with existing diffusion frameworks. Experiments show that Ctrl-Z Sampling consistently improves generation quality over other inference-time scaling samplers across different NFE budgets, offering a scalable compute-quality trade-off. Code available at: https://github.com/ShunqiM/Ctrl-Z-Sampling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。