单步生成高质量样本,计算效率提升近百倍
Single-Step Consistent Diffusion Samplers
- 从预训练模型蒸馏出单步采样器,无需大量样本数据
- 仅需传统方法1%的网络评估次数,即可生成高保真样本
- 适合对速度敏感或资源受限的实时应用
从非归一化目标分布中采样是机器学习与统计学中的基础但具挑战性任务。现有采样算法通常需要大量迭代步骤才能生成高质量样本,导致计算成本高,在时间敏感或资源受限场景下难以实用。本文提出一致扩散采样器(consistent diffusion samplers),一种可在单步内生成高保真样本的新类采样器。我们首先设计了一种蒸馏算法,从预训练扩散模型中训练一致扩散采样器,无需预先收集大规模样本数据集,而是直接利用扩散过程中的不完整采样轨迹和噪声中间状态。此外,我们还提出一种从零训练的方法,通过自一致性损失,让单一模型同时完成扩散采样并跳过中间步骤,实现完全可优化的探索。在多种非归一化分布上的大量实验表明,该方法仅需传统扩散采样器1%的网络评估次数,即可生成高质量样本。
原文摘要 · Abstract (English)
Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high computational costs that limit their practicality in time-sensitive or resource-constrained settings. In this work, we introduce consistent diffusion samplers, a new class of samplers designed to generate high-fidelity samples in a single step. We first develop a distillation algorithm to train a consistent diffusion sampler from a pretrained diffusion model without pre-collecting large datasets of samples. Our algorithm leverages incomplete sampling trajectories and noisy intermediate states directly from the diffusion process. We further propose a method to train a consistent diffusion sampler from scratch, fully amortizing exploration by training a single model that both performs diffusion sampling and skips intermediate steps using a self-consistency loss. Through extensive experiments on a variety of unnormalized distributions, we show that our approach yields high-fidelity samples using less than 1% of the network evaluations required by traditional diffusion samplers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。