arXiv:2602.06155cs.LGstat.ML2026-02

高置信度样本揭示扩散模型隐空间的类别结构

Latent Structure Emergence in Diffusion Models via Confidence-Based Filtering

  • 用预训练分类器对生成样本的置信度筛选噪声种子
  • 仅保留高置信度样本时,隐空间展现明显类别可分性
  • 适合做条件生成或无需引导的可控生成研究者

扩散模型依赖初始噪声种子的高维隐空间,但该空间是否蕴含可预测生成样本属性(如类别)的结构仍不明确。本文通过分析预训练分类器对生成样本赋予的置信度,发现尽管所有噪声实现在整体上看似无结构,但若仅关注生成高置信度样本的初始噪声种子,则能观察到显著的类别可分性。通过比较不同置信度子集下的类别可预测性及隐空间的类间分离度,我们证实了类别相关隐结构的存在,其仅在置信度筛选后显现。作为实际应用,置信度筛选可实现条件生成,为替代基于引导的方法提供新路径。

原文摘要 · Abstract (English)

Diffusion models rely on a high-dimensional latent space of initial noise seeds, yet it remains unclear whether this space contains sufficient structure to predict properties of the generated samples, such as their classes. In this work, we investigate the emergence of latent structure through the lens of confidence scores assigned by a pre-trained classifier to generated samples. We show that while the latent space appears largely unstructured when considering all noise realizations, restricting attention to initial noise seeds that produce high-confidence samples reveals pronounced class separability. By comparing class predictability across noise subsets of varying confidence and examining the class separability of the latent space, we find evidence of class-relevant latent structure that becomes observable only under confidence-based filtering. As a practical implication, we discuss how confidence-based filtering enables conditional generation as an alternative to guidance-based methods.

扩散模型隐空间结构条件生成置信度筛选

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。