提出新型图网络,动态聚焦关键节点连接,解决深度图模型过平滑问题。
Focus Where It Matters: Graph Selective State Focused Attention Networks
- 用多头掩码自注意力动态强化重要边,适应图结构变化
- 在四个基准数据集上提升分类准确率1.56%至8.94%(F1-score)
- 无需图结构先验知识,可泛化到未见结构,适合动态图场景
传统图神经网络因过平滑问题在深层网络中丧失节点特性,影响动态图任务表现。为此,本文提出图选择状态聚焦注意力网络(GSAN),结合多头掩码自注意力(MHMSA)与选择性状态空间建模(S3M)层,克服传统GNN局限。其中,MHMSA能动态强调关键节点连接,尤其在演化图环境中;S3M层可自适应调整节点状态变化,在无图结构先验下提升节点行为预测能力,并增强对未知结构的泛化性,揭示节点状态如何影响边的重要性。在Cora、Citeseer、Pubmed及蛋白互作(PPI)等图基准数据集上的对比实验表明,GSAN在F1-score上分别提升1.56%、8.94%、0.37%和1.54%。
原文摘要 · Abstract (English)
Traditional graph neural networks (GNNs) lack scalability and lose individual node characteristics due to over-smoothing, especially in the case of deeper networks. This results in sub-optimal feature representation, affecting the model's performance on tasks involving dynamically changing graphs. To address this issue, we present Graph Selective States Focused Attention Networks (GSANs) based neural network architecture for graph-structured data. The GSAN is enabled by multi-head masked self-attention (MHMSA) and selective state space modeling (S3M) layers to overcome the limitations of GNNs. In GSAN, the MHMSA allows GSAN to dynamically emphasize crucial node connections, particularly in evolving graph environments. The S3M layer enables the network to adjust dynamically in changing node states and improving predictions of node behavior in varying contexts without needing primary knowledge of the graph structure. Furthermore, the S3M layer enhances the generalization of unseen structures and interprets how node states influence link importance. With this, GSAN effectively outperforms inductive and transductive tasks and overcomes the issues that traditional GNNs experience. To analyze the performance behavior of GSAN, a set of state-of-the-art comparative experiments are conducted on graphs benchmark datasets, including $Cora$, $Citeseer$, $Pubmed$ network citation, and $protein-protein-interaction$ datasets, as an outcome, GSAN improved the classification accuracy by $1.56\%$, $8.94\%$, $0.37\%$, and $1.54\%$ on $F1-score$ respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。