用随机加权支撑点生成数据,无需神经网络也能高效可解释。
Weighted Support Points from Random Measures: An Interpretable Alternative for Generative Modeling
- 基于狄利克雷过程的加权方案生成代表性数据点
- 在MNIST和CelebA-HQ上实现高质量多样采样,计算成本仅为GAN的几分之一
- 生成结果能保持数据结构,适合需要可解释性的场景
支撑点通过少量代表性点总结大规模数据集,可用于无需访问全量数据的蒙特卡洛积分等操作。本文提出一种基于随机加权支撑点的生成建模框架,其随机性源于狄利克雷过程与贝叶斯自助法启发的加权机制。该方法可在不依赖概率建模假设或神经网络的前提下,从固定数据集生成多样化且可解释的样本集。我们给出了理论框架,并基于凸-凹规划(CCP)开发了高效优化算法。在MNIST与CelebA-HQ数据集上的实验表明,该方法以远低于生成对抗网络(GAN)或去噪扩散概率模型(DDPM)的计算开销,生成高质量且多样化的输出。结果表明,随机加权支撑点为生成建模提供了原理严谨、可扩展且可解释的替代方案。关键优势在于能生成真正插值性样本,保留底层数据结构。
原文摘要 · Abstract (English)
Support points summarize a large dataset through a smaller set of representative points that can be used for data operations, such as Monte Carlo integration, without requiring access to the full dataset. In this sense, support points offer a compact yet informative representation of the original data. We build on this idea to introduce a generative modeling framework based on random weighted support points, where the randomness arises from a weighting scheme inspired by the Dirichlet process and the Bayesian bootstrap. The proposed method generates diverse and interpretable sample sets from a fixed dataset, without relying on probabilistic modeling assumptions or neural network architectures. We present the theoretical formulation of the method and develop an efficient optimization algorithm based on the Convex--Concave Procedure (CCP). Empirical results on the MNIST and CelebA-HQ datasets show that our approach produces high-quality and diverse outputs at a fraction of the computational cost of black-box alternatives such as Generative Adversarial Networks (GANs) or Denoising Diffusion Probabilistic Models (DDPMs). These results suggest that random weighted support points offer a principled, scalable, and interpretable alternative for generative modeling. A key feature is their ability to produce genuinely interpolative samples that preserve underlying data structure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。