不依赖扩散模型,用层级预测实现快速高质量图生成
Diffusion-Free Graph Generation with Next-Scale Prediction
- 通过层级潜在表示逐步生成图结构,无需节点顺序
- 在分子和通用图数据集上推理速度提升千倍以上
- 适合需要高效生成的科研与工业场景
自回归模型在效率和可扩展性方面表现优异,能无缝融入Transformer生态,但需显式序列顺序,与图的无序特性冲突。扩散模型虽保持排列不变性且支持单次生成,但需上千次去噪步骤并依赖额外特征,计算成本高。受图像生成领域自回归方法成功的启发,我们提出MAG框架,一种基于下一尺度预测的新型无扩散图生成方法。通过层次化潜在表示,模型在无需显式节点排序的情况下,逐步生成整个图的多尺度结构。在通用图与分子图数据集上的实验表明,该方法相比现有最先进方法推理速度提升达三个数量级,同时保持高质量生成能力。
原文摘要 · Abstract (English)
Autoregressive models excel in efficiency and plug directly into the transformer ecosystem, delivering robust generalization, predictable scalability, and seamless workflows such as fine-tuning and parallelized training. However, they require an explicit sequence order, which contradicts the unordered nature of graphs. In contrast, diffusion models maintain permutation invariance and enable one-shot generation but require up to thousands of denoising steps and additional features for expressivity, leading to high computational costs. Inspired by recent breakthroughs in image generation, especially the success of visual autoregressive methods, we propose MAG, a novel diffusion-free graph generation framework based on next-scale prediction. By leveraging a hierarchy of latent representations, the model progressively generates scales of the entire graph without the need for explicit node ordering. Experiments on both generic and molecular graph datasets demonstrated the potential of this method, achieving inference speedups of up to three orders of magnitude over state-of-the-art methods, while preserving high-quality generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。