提出图结构引导的对抗学习新理论,提升生成模型稳定性与结构还原能力
Graph-Informed Adversarial Modeling: Infimal Subadditivity of Interpolative Divergences
- 基于贝叶斯网络构建分层判别器,利用图结构分解全局差异度量
- 证明插值散度满足极小次可加性,在加法情形下逼近误差为零
- 适用于多种生成模型框架,适合需结构化建模的生成任务
研究目标分布由已知贝叶斯网络因子分解时的对抗学习问题。针对包括$(f,Γ)$-散度在内的插值散度,我们证明了一种新的极小次可加性原理:在合适条件下,全局变分差异可被与图结构对齐的局部差异平均值控制。在加法情形下,近似是精确的。这填补了文献中的理论空白——现有次可加性结果仅支持经典散度下的图结构引导对抗学习,但不适用于插值散度(因常规因子分解方法失效)。由此,我们为用局部家族判别器替代标准全局判别器的图结构引导GAN(GiGAN)提供了理论依据,无需优化器本身遵循图结构。同时,我们还获得了积分概率度量和近端最优传输散度的平行结果,识别出适用的自然判别器类别,并通过实验验证其相比无图基线在稳定性和结构恢复方面表现更优。
原文摘要 · Abstract (English)
We study adversarial learning when the target distribution factorizes according to a known Bayesian network. For interpolative divergences, including $(f,Γ)$-divergences, we prove a new infimal subadditivity principle showing that, under suitable conditions, a global variational discrepancy is controlled by an average of family-level discrepancies aligned with the graph. In an additive regime, the surrogate is exact. This closes a theoretical gap in the literature; existing subadditivity results justify graph-informed adversarial learning for classical discrepancies, but not for interpolative divergences, where the usual factorization argument breaks down. In turn, we provide a justification for replacing a standard, graph-agnostic GAN with a monolithic discriminator by a graph-informed GAN (GiGAN) with localized family-level discriminators, without requiring the optimizer itself to factorize according to the graph. We also obtain parallel results for integral probability metrics and proximal optimal transport divergences, identify natural discriminator classes for which the theory applies, and present experiments showing improved stability and structural recovery relative to graph-agnostic baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。