arXiv:2606.13347cs.LG2026-06

不增加训练,仅在采样时引导模型生成稀有图像,提升长尾覆盖。

Enhanced Low-Density Region Exploration in Classifier-Guided Diffusion Models Through Modified Reverse Diffusion Sampling

论文配图:Enhanced Low-Density Region Exploration in Classifier-Guided Diffusion Models Through Modified Reverse Diffusion Sampling
图 1 · 摘自论文原文
  • 采样时用修正梯度引导模型往低置信区域走,探索稀有样本。
  • 64x66分辨率下召回率提升,FID保持相近,256x256效果更明显。
  • 适合关注生成多样性、长尾分布的图像生成研究者。

扩散模型在高保真图像生成中表现卓越,但标准分类器引导会将概率集中在高密度类均值附近,导致类条件分布尾部稀有样本覆盖差。现有方法通过额外训练低密度探测分类器缓解此问题,但需增加网络和训练成本。本文提出一种纯采样阶段的密度感知扩展,无需额外训练,仅在采样时修改分类器引导路径:在噪声图像上施加修正的分类器梯度,引导轨迹向低置信区域移动;同时每步也引导生成结果靠近预测的真实图像。第一重引导促进探索低概率样本,第二重引导确保生成样本贴近真实数据流形。在64x64分辨率的ADM模型上,该方法显著提升召回率且保持相当的FID;256x256模型下,可视化显示两种引导组合可生成高质量、多样化的图像。结果显示,标准分类器引导结合真实图像预测引导,可在ImageNet上生成高感知质量样本。

原文摘要 · Abstract (English)

Diffusion models have emerged as state-of-the-art generative models for high-fidelity image synthesis, particularly in their classifier-free guided and classifier-guided forms. However, standard classifier guidance concentrates probability mass around high-density class mean, leading to poor coverage of rare samples in the tails of the class-conditional distributions. Recent work on diffusion-based tail sampling mitigates this by training an additional low-density-seeking classifier with a synthetic-vs-real discriminator, at the cost of additional networks and training. In parallel, a number of samplers and distillation techniques accelerate or refine diffusion sampling, but do not explicitly address long-tail coverage. We propose a purely sampling-time, density-aware extension of classifier-guided conditional diffusion model that targets low-density regions without any additional training. We have applied guidance at noisy images not on predicted noise like most diffusion models. Starting from a pretrained conditional diffusion model and classifier on ImageNet, we modify the guided reverse dynamics by steering trajectories toward low-confidence regions via the modified classifier gradient, and at each time step, we also guide the sampling process toward the predicted real image. 1st guidance helps explore low-probability samples, and 2nd guidance helps to generate samples to be close to the real data manifold. The proposed sampler consistently improves ADM model recall at 64x64 resolution while maintaining a comparable FID, and with a 256x256 ADM model, we showed the results visually with different combinations of both guidance. We also showed that standard ADM classifier guidance, combined with predicted real image guidance, helps generate high perceptual quality samples with a 256x256 ADM model on ImageNet.

扩散模型图像生成长尾分布采样优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。