arXiv:2601.08379cs.LGcs.AI2026-01被引 4

无需训练,用最大均值差异让扩散模型生成更符合目标数据的样本。

MMD Guidance: Training-Free Distribution Adaptation for Diffusion Models via Maximum Mean Discrepancy Guidance

  • 通过MMD梯度直接引导采样过程,实现分布对齐。
  • 在少量参考样本下仍能有效匹配目标分布,保持生成质量。
  • 适用于条件生成与潜在扩散模型,计算高效适合实际应用。

预训练扩散模型虽具备强大生成能力,但其输出常偏离用户特定目标数据特征,尤其在仅有少量参考样本且无法重训练的领域自适应任务中问题突出。现有推理阶段引导方法多优化代理目标(如分类器似然),而非直接对齐目标分布。本文提出MMD Guidance,一种无需训练的机制,在反向扩散过程中引入生成样本与参考数据集间最大均值差异(MMD)的梯度,以实现分布对齐。MMD可从有限数据中提供可靠分布估计,实际中方差低且可高效微分,非常适合该任务。框架自然扩展至条件生成中的提示感知适应,通过乘积核实现;同时可在潜在扩散模型(LDMs)的潜在空间中高效应用。合成与真实世界基准测试表明,该方法在保持生成保真度的同时实现良好分布对齐。项目代码已开源。

原文摘要 · Abstract (English)

Pre-trained diffusion models have emerged as powerful generative priors for both unconditional and conditional sample generation, yet their outputs often deviate from the characteristics of user-specific target data. Such mismatches are especially problematic in domain adaptation tasks, where only a few reference examples are available and retraining the diffusion model is infeasible. Existing inference-time guidance methods can adjust sampling trajectories, but they typically optimize surrogate objectives such as classifier likelihoods rather than directly aligning with the target distribution. We propose \emph{MMD Guidance}, a training-free mechanism that augments the reverse diffusion process with gradients of the \textit{Maximum Mean Discrepancy (MMD)} between generated samples and a reference dataset. MMD provides reliable distributional estimates from limited data, exhibits low variance in practice, and is efficiently differentiable, which makes it particularly well-suited for the guidance task. Our framework naturally extends to prompt-aware adaptation in conditional generation models via product kernels. Also, it can be applied with computational efficiency in latent diffusion models (LDMs), since guidance is applied in the latent space of the LDM. Experiments on synthetic and real-world benchmarks demonstrate that MMD Guidance can achieve distributional alignment while preserving sample fidelity. The project code is available at github.com/matinamehdizadeh/MMD-Guidance.

扩散模型分布对齐无训练引导MMD

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。