arXiv:2508.21255stat.MLcs.LG2025-08

用随机加权支撑点生成数据,无需神经网络也能高效可解释。

Weighted Support Points from Random Measures: An Interpretable Alternative for Generative Modeling

  • 基于狄利克雷过程的加权方案生成代表性数据点
  • 在MNIST和CelebA-HQ上实现高质量多样采样,计算成本仅为GAN的几分之一
  • 生成结果能保持数据结构,适合需要可解释性的场景

支撑点通过少量代表性点总结大规模数据集,可用于无需访问全量数据的蒙特卡洛积分等操作。本文提出一种基于随机加权支撑点的生成建模框架,其随机性源于狄利克雷过程与贝叶斯自助法启发的加权机制。该方法可在不依赖概率建模假设或神经网络的前提下,从固定数据集生成多样化且可解释的样本集。我们给出了理论框架,并基于凸-凹规划(CCP)开发了高效优化算法。在MNIST与CelebA-HQ数据集上的实验表明,该方法以远低于生成对抗网络(GAN)或去噪扩散概率模型(DDPM)的计算开销,生成高质量且多样化的输出。结果表明,随机加权支撑点为生成建模提供了原理严谨、可扩展且可解释的替代方案。关键优势在于能生成真正插值性样本,保留底层数据结构。

原文摘要 · Abstract (English)

Support points summarize a large dataset through a smaller set of representative points that can be used for data operations, such as Monte Carlo integration, without requiring access to the full dataset. In this sense, support points offer a compact yet informative representation of the original data. We build on this idea to introduce a generative modeling framework based on random weighted support points, where the randomness arises from a weighting scheme inspired by the Dirichlet process and the Bayesian bootstrap. The proposed method generates diverse and interpretable sample sets from a fixed dataset, without relying on probabilistic modeling assumptions or neural network architectures. We present the theoretical formulation of the method and develop an efficient optimization algorithm based on the Convex--Concave Procedure (CCP). Empirical results on the MNIST and CelebA-HQ datasets show that our approach produces high-quality and diverse outputs at a fraction of the computational cost of black-box alternatives such as Generative Adversarial Networks (GANs) or Denoising Diffusion Probabilistic Models (DDPMs). These results suggest that random weighted support points offer a principled, scalable, and interpretable alternative for generative modeling. A key feature is their ability to produce genuinely interpolative samples that preserve underlying data structure.

生成模型可解释性支撑点无神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。