arXiv:2602.18216cs.LG2026-02

不用编码器的生成模型,训练快且稳定,适合小样本数据生成。

Generative Model via Quantile Assignment

  • 用量化分配替代编码器,通过线性分配求解潜在变量。
  • 图像质量更高,训练时间最短,小样本下表现优异。
  • 适合对速度和稳定性要求高的合成数据生成场景。

深度生成模型在现代机器学习中承担两个核心任务:生成新信息(如图像合成)与降维。传统架构常依赖辅助网络(如变分自编码器中的编码器或生成对抗网络中的判别器),导致训练不稳定、计算开销大,并存在模式崩溃风险。本文提出NeuroSQL,一种无需辅助网络的新生成范式,通过渐近逼近将潜在变量表达为最优传输问题的解,隐式学习低维潜在表示。NeuroSQL通过求解线性分配问题获得潜在信息,再传递给独立生成器。在手写数字(MNIST)、人脸(CelebA)、动物脸(AFHQ)和脑影像(OASIS)四个数据集上,相较于VAEs、GANs及预算匹配的扩散模型:(1)图像质量更优,合成与真实图像间均像素距离更低,感知与结构保真度更强;(2)训练耗时最少;(3)在有限训练样本下仍能有效生成合成数据。通过采用量化分配而非编码器,NeuroSQL提供了快速、稳定、鲁棒的合成数据生成方式,信息损失最小。

原文摘要 · Abstract (English)

Deep Generative models (DGMs) play two key roles in modern machine learning: (i) producing new information (e.g., image synthesis) and (ii) reducing dimensionality. However, traditional architectures often rely on auxiliary networks such as encoders in Variational Autoencoders (VAEs) or discriminators in Generative Adversarial Networks (GANs), which introduce training instability, computational overhead, and risks like mode collapse. We present NeuroSQL, a new generative paradigm that eliminates the need for auxiliary networks by learning low-dimensional latent representations implicitly. NeuroSQL leverages an asymptotic approximation that expresses the latent variables as the solution to an optimal transportation problem. Specifically, NeuroSQL learns the latent variables by solving a linear assignment problem and then passes the latent information to a standalone generator. We benchmark its performance against GANs, VAEs, and a budget-matched diffusion baseline on four datasets: handwritten digits (MNIST), faces (CelebA), animal faces (AFHQ), and brain images (OASIS). Compared to VAEs, GANs, and diffusion models: (1) in terms of image quality, NeuroSQL achieves overall lower mean pixel distance between synthetic and authentic images and stronger perceptual/structural fidelity; (2) computationally, NeuroSQL requires the least training time; and (3) practically, NeuroSQL provides an effective solution for generating synthetic data with limited training samples. By embracing quantile assignment rather than an encoder, NeuroSQL provides a fast, stable, and robust way to generate synthetic data with minimal information loss.

生成模型量化分配小样本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。