arXiv:2410.11646cs.CV2024-10被引 3

用特征投影引导扩散过程,实现高质量条件生成。

Feature-guided score diffusion for sampling conditional densities

  • 通过投影图像特征向量至类别中心,引导扩散过程
  • 使同类别样本特征聚集,不同类别中心分离,形成低维嵌入
  • 支持类间插值生成,展现分布外泛化能力

Score diffusion 方法可从样本中学习概率密度。通过深度神经网络估计噪声密度的 score,再迭代将高斯白噪声密度转换为目标密度。针对条件密度的变体虽已提出,但正确估计对应 score 仍具挑战。本文提出一种新算法,通过投影 score 引导扩散过程:将图像特征向量投影至目标类别的特征中心。该投影 score 与特征向量由同一网络联合学习,其中特征向量定义为网络选定层通道激活的空间平均。优化 denoising loss 可促使每类图像特征向量聚集于其类中心,并增强类中心间的分离。这些中心构成类别条件密度的低维欧氏嵌入。实验表明,该方法能从指定类别生成高质量且多样化的样本;通过训练集特征向量之间的插值,还可实现分布外生成。

原文摘要 · Abstract (English)

Score diffusion methods can learn probability densities from samples. The score of the noise-corrupted density is estimated using a deep neural network, which is then used to iteratively transport a Gaussian white noise density to a target density. Variants for conditional densities have been developed, but correct estimation of the corresponding scores is difficult. We avoid these difficulties by introducing an algorithm that guides the diffusion with a projected score. The projection pushes the image feature vector towards the feature vector centroid of the target class. The projected score and the feature vectors are learned by the same network. Specifically, the image feature vector is defined as the spatial averages of the channels activations in select layers of the network. Optimizing the projected score for denoising loss encourages image feature vectors of each class to cluster around their centroids. It also leads to the separations of the centroids. We show that these centroids provide a low-dimensional Euclidean embedding of the class conditional densities. We demonstrate that the algorithm can generate high quality and diverse samples from the conditioning class. Conditional generation can be performed using feature vectors interpolated between those of the training set, demonstrating out-of-distribution generalization.

扩散模型条件生成特征嵌入类中心

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。