arXiv:2601.13780cs.LG2026-01被引 2

将图压缩到低维隐空间,实现高效且近乎无损的图生成。

Principled Latent Diffusion for Graphs via Laplacian Autoencoders

  • 用置换等变自编码器将图映射到线性增长的低维隐空间。
  • 在隐空间中训练扩散变压器,生成效果媲美顶尖模型,速度提升千倍。
  • 适合需要大规模图生成且要求高精度重建的场景。

图扩散模型在图生成任务中表现优异,但其复杂度随节点数呈二次增长,且大量计算资源被浪费在稀疏图中无边的建模上。受其他模态隐扩散启发,一个自然思路是将图压缩至低维隐空间进行扩散。然而,与图像或文本不同,图生成需近乎无损重建,因为邻接矩阵中任意错误都会使整个样本无效,该挑战长期未被解决。本文提出LG-Flow,一种直接克服上述难题的隐式图扩散框架。其置换等变自编码器将节点映射为固定维度嵌入,实现无向图与有向无环图的近似无损重建。隐表示维度随节点数线性增长,从而消除扩散过程中的二次邻接空间瓶颈,支持训练更大规模生成主干网络。在该隐空间中,我们采用流匹配训练扩散变压器,实现高效且强大的图生成。实验表明,本方法在性能上可比肩最先进模型,同时实现高达1000倍的速度提升。代码已开源:https://github.com/asiraudin/LG-Flow。

原文摘要 · Abstract (English)

Graph diffusion models achieve state-of-the-art performance in graph generation but suffer from quadratic complexity in the number of nodes -- and much of their capacity is wasted modeling the absence of edges in sparse graphs. Inspired by latent diffusion in other modalities, a natural idea is to compress graphs into a low-dimensional latent space and perform diffusion in that space. However, unlike images or text, graph generation requires nearly lossless reconstruction, as even a single error in decoding an adjacency matrix can render the entire sample invalid. This challenge has remained largely unaddressed. We propose LG-Flow, a latent graph diffusion framework that directly overcomes these obstacles. A permutation-equivariant autoencoder maps nodes to fixed-dimensional embeddings that enable near-lossless reconstruction of both undirected graphs and DAGs. The dimensionality of this latent representation scales linearly with the number of nodes, thereby removing the quadratic adjacency-space bottleneck in the diffusion process and enabling the training of substantially larger generative backbones. In this latent space, we train a Diffusion Transformer with flow matching, enabling efficient and expressive graph generation. Our approach achieves competitive results against state-of-the-art graph diffusion models while delivering up to a $1000\times$ speed-up. Our code is available at https://github.com/asiraudin/LG-Flow .

图生成扩散模型隐空间高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。