arXiv:2410.08549cs.LG2024-10被引 2

让生成模型学会跨分布采样,仅用一张新图就能生成多张同类图像。

Score Neural Operator: A Generative Model for Learning and Generalizing Across Multiple Probability Distributions

  • 构建统一框架,学习多个分布到其得分函数的映射关系。
  • 在二维混合高斯与1024维手写数字数据上展现强泛化能力。
  • 支持少样本生成,单张图可生成多张新分布样本,适合小数据场景。

现有生成模型通常只能学习单一概率分布,难以推广到未见分布。本文提出Score Neural Operator,统一框架下学习从多个概率分布到其得分函数的映射。采用隐空间技术缓解像素空间中得分匹配的过拟合问题,提升生成质量。训练后的模型能预测训练外分布的得分函数,在二维高斯混合模型和1024维MNIST双数字数据集上表现优异。更重要的是,该方法具备显著少样本学习潜力:仅需一张新分布图像,即可生成该分布的多张不同样本。

原文摘要 · Abstract (English)

Most existing generative models are limited to learning a single probability distribution from the training data and cannot generalize to novel distributions for unseen data. An architecture that can generate samples from both trained datasets and unseen probability distributions would mark a significant breakthrough. Recently, score-based generative models have gained considerable attention for their comprehensive mode coverage and high-quality image synthesis, as they effectively learn an operator that maps a probability distribution to its corresponding score function. In this work, we introduce the $\emph{Score Neural Operator}$, which learns the mapping from multiple probability distributions to their score functions within a unified framework. We employ latent space techniques to facilitate the training of score matching, which tends to over-fit in the original image pixel space, thereby enhancing sample generation quality. Our trained Score Neural Operator demonstrates the ability to predict score functions of probability measures beyond the training space and exhibits strong generalization performance in both 2-dimensional Gaussian Mixture Models and 1024-dimensional MNIST double-digit datasets. Importantly, our approach offers significant potential for few-shot learning applications, where a single image from a new distribution can be leveraged to generate multiple distinct images from that distribution.

生成模型少样本学习分布泛化得分网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。