用超图与状态空间模型结合,提升节点分类的表达能力。
Hypergraph Neural Network with State Space Models for Node Classification
- 通过超图构建高阶关系,融合角色特征与邻接信息
- 在多个基准数据集上超越现有基线模型,最高提升3.2%准确率
- 适合需要捕捉复杂结构关系的节点分类任务
近年来,图神经网络(GNNs)在图结构数据的节点分类任务中备受关注。然而,传统GNN主要关注节点间的邻接关系,常忽视可提供互补信息的角色特征。现有提取角色特征的方法多为无监督,难以有效应用于下游预测任务。为此,我们提出超图神经网络与状态空间模型结合的HGMN框架。该模型通过超图构建与状态空间建模的有机结合,将角色感知表示融入GNN。HGMN采用基于度和基于邻域的两种超图构造策略,增强结构相似节点间的连通性,丰富表征。引入超图卷积层以建模超图内部复杂依赖,并使用残差连接缓解深层网络中的过平滑问题,提升特征传播效率。在OGB、ACM、DBLP、IIP TerroristRel、Cora、Citeseer和Pubmed等基准数据集上的实验表明,HGMN在节点分类任务中持续优于强基线模型,验证了在超图框架中显式引入角色特征对节点分类具有实际益处。
原文摘要 · Abstract (English)
In recent years, graph neural networks (GNNs) have gained significant attention for node classification tasks on graph-structured data. However, traditional GNNs primarily focus on adjacency relationships between nodes, often overlooking the role-based characteristics that can provide complementary insights for learning expressive node representations. Existing frameworks for extracting role-based features are largely unsupervised and often fail to translate effectively into downstream predictive tasks. To address these limitations, we propose a hypergraph neural network with a state space model (HGMN). The model integrates role-aware representations into GNNs by combining hypergraph construction with state-space modeling in a principled manner. HGMN employs hypergraph construction techniques to capture higher-order relationships and leverages a learnable mamba transformer mechanism to fuse role-based and adjacency-based embeddings. By exploring two distinct hypergraph construction strategies, degree-based and neighborhood-based, the framework reinforces connectivity among nodes with structural similarity, thereby enriching the learned representations. Furthermore, the inclusion of hypergraph convolution layers enables the model to account for complex dependencies within hypergraph structures. To alleviate the over-smoothing problem encountered in deeper networks, we incorporate residual connections, which improve stability and promote effective feature propagation across layers. Comprehensive experiments on benchmark datasets including OGB, ACM, DBLP, IIP TerroristRel, Cora, Citeseer, and Pubmed demonstrate that HGMN consistently outperforms strong baselines in node classification tasks. These results support the claim that explicitly incorporating role-based features within a hypergraph framework offers tangible benefits for node classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。