arXiv:2609.07961cs.LGcs.CV2026-09

用可逆注意力流显式建模图结构,提升表达力与可解释性。

$\alpha$-Graph: Attention-Infused Normalizing Flow Approach to Tractable Graph Modeling

论文配图:$\alpha$-Graph: Attention-Infused Normalizing Flow Approach to Tractable Graph Modeling
图 1 · 摘自论文原文
  • 引入可逆注意力机制的无条件图归一化流,显式捕捉复杂关系
  • 设计可学习查询的条件图流,高效建模图内相关性
  • 在3个基准上达到领先性能,兼具稳定性与效率

图建模是表示图结构数据中复杂关系的关键任务,近年来取得显著进展。然而,现有方法依赖传统图神经网络和预训练技术隐式学习底层关系结构,难以捕捉复杂的图结构及输入间的关联。本文提出一种新型基于注意力的归一化流图建模方法(ANFA,即α-Graph),实现显式、可解释且可计算的图建模。我们设计了一种带有可逆注意力机制的无条件图归一化流,以捕获图数据的复杂关系结构;为进一步增强模型表达能力,引入带有可学习查询的条件图归一化流,实现对图结构数据相关性的高效建模。实验表明,条件图归一化流在保持训练稳定性和效率的同时,表达能力优于无条件版本。在三个基准数据集上的结果验证了α-Graph的有效性与最先进的性能。

原文摘要 · Abstract (English)

Graph modeling, a crucial task for representing complex relationships in graph-structured data, has achieved significant success in recent years. However, current graph modeling methods rely on traditional Graph Neural Networks and pre-training approaches to implicitly learn the underlying relational structure of graph data. Thus, these prior methods cannot capture the complex graph structure and correlations among inputs. In this paper, we introduce a novel Attention-based Normalizing Flow-based Approach\footnote{Our implementation and models will be released publicly for research reproducibility.} (ANFA or $\alpha$) that provides an explicit, interpretable, and tractable Graph Modeling ($\alpha$-Graph). In particular, we propose a new Unconditional Graph Normalizing Flow with an Invertible Attention Mechanism to capture the complex relational structure of graph data. To further enhance the expressiveness of the model, we introduce Conditional Graph Normalizing Flow with Learnable Queries that enables efficient modeling of correlations in graph-structured data. We show that our Conditional Graph Normalizing Flows behave similarly to Unconditional Graph Normalizing Flows, enhancing expressiveness while maintaining training stability and efficiency. Our experimental results on three benchmarks will illustrate the effectiveness and the state-of-the-art (SoTA) performance of the proposed $\alpha$-Graph method.

图建模归一化流注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。