arXiv:2510.26892cs.LGcs.AI2025-10

提出贝叶斯版DCGAN,提升生成多样性并量化不确定性。

BI-DCGAN: A Theoretically Grounded Bayesian Framework for Efficient and Diverse GANs

  • 用贝叶斯方法建模权重分布,通过反向传播学习参数不确定性。
  • 理论证明贝叶斯建模可提升样本多样性,实验验证优于传统DCGAN。
  • 适合需要高多样性与可信度的生成任务,尤其替代资源密集型扩散模型。

生成对抗网络(GAN)虽能生成合成数据,但普遍存在模式崩溃问题,即生成器输出范围狭窄,难以覆盖完整数据分布。这一缺陷在真实场景应用中尤为严重,因生成模型需兼顾多样性和不确定性感知。为此,我们提出BI-DCGAN,一种基于贝叶斯思想的DCGAN扩展,将模型不确定性融入生成过程,同时保持计算效率。该方法结合贝叶斯反向传播(Bayes by Backprop)学习权重分布,并采用均值场变分推断(mean-field variational inference)高效近似训练期间的后验分布。我们首次基于协方差矩阵分析,建立了贝叶斯建模提升样本多样性的理论证明。在标准生成基准上的大量实验表明,BI-DCGAN生成结果更具多样性与鲁棒性,且训练效率不降。该成果为对多样性与不确定性要求高的场景提供了一种可扩展、高效的解决方案,相较扩散模型等现代方法更轻量,适合实际部署。

原文摘要 · Abstract (English)

Generative Adversarial Networks (GANs) are proficient at generating synthetic data but continue to suffer from mode collapse, where the generator produces a narrow range of outputs that fool the discriminator but fail to capture the full data distribution. This limitation is particularly problematic, as generative models are increasingly deployed in real-world applications that demand both diversity and uncertainty awareness. In response, we introduce BI-DCGAN, a Bayesian extension of DCGAN that incorporates model uncertainty into the generative process while maintaining computational efficiency. BI-DCGAN integrates Bayes by Backprop to learn a distribution over network weights and employs mean-field variational inference to efficiently approximate the posterior distribution during GAN training. We establishes the first theoretical proof, based on covariance matrix analysis, that Bayesian modeling enhances sample diversity in GANs. We validate this theoretical result through extensive experiments on standard generative benchmarks, demonstrating that BI-DCGAN produces more diverse and robust outputs than conventional DCGANs, while maintaining training efficiency. These findings position BI-DCGAN as a scalable and timely solution for applications where both diversity and uncertainty are critical, and where modern alternatives like diffusion models remain too resource-intensive.

GAN贝叶斯多样性生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。