通过块空间扩散提升图生成模型的可扩展性与规模泛化能力
SBGD: Improving Graph Diffusion Generative Model via Stochastic Block Diffusion
- 将图结构分解为块空间,降低内存占用
- 内存节省最高达6倍,生成质量不降反升
- 适合大规模图生成与跨尺寸应用
图扩散生成模型(GDGMs)在生成高质量图方面表现优异,但面临可扩展性和规模泛化能力不足的问题。现有方法通常在全图空间中操作,导致训练和推理时需将整个图存入内存,难以处理大规模真实图数据。同时,其生成图的尺寸受限于训练数据,泛化能力差。为此,本文提出随机块图扩散(SBGD)模型,将图表示重构到基于真实图结构先验的块图空间,显著降低内存复杂度,实现对大规模图的可扩展生成。该块表示还增强了对未见图尺寸的泛化能力。实验表明,SBGD在内存使用上最多减少6倍,同时保持甚至优于现有最优方法的生成性能,且在不同图尺寸上的泛化能力更优。SBGD不仅是一种高效可扩展的生成模型,也体现了生成建模中的模块化思想,为复杂任务分解提供了新思路。
原文摘要 · Abstract (English)
Graph diffusion generative models (GDGMs) have emerged as powerful tools for generating high-quality graphs. However, their broader adoption faces challenges in \emph{scalability and size generalization}. GDGMs struggle to scale to large graphs due to their high memory requirements, as they typically operate in the full graph space, requiring the entire graph to be stored in memory during training and inference. This constraint limits their feasibility for large-scale real-world graphs. GDGMs also exhibit poor size generalization, with limited ability to generate graphs of sizes different from those in the training data, restricting their adaptability across diverse applications. To address these challenges, we propose the stochastic block graph diffusion (SBGD) model, which refines graph representations into a block graph space. This space incorporates structural priors based on real-world graph patterns, significantly reducing memory complexity and enabling scalability to large graphs. The block representation also improves size generalization by capturing fundamental graph structures. Empirical results show that SBGD achieves significant memory improvements (up to 6$\times$) while maintaining comparable or even superior graph generation performance relative to state-of-the-art methods. Furthermore, experiments demonstrate that SBGD better generalizes to unseen graph sizes. The significance of SBGD extends beyond being a scalable and effective GDGM; it also exemplifies the principle of modularization in generative modeling, offering a new avenue for exploring generative models by decomposing complex tasks into more manageable components.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。