通过感知节点重叠度的元学习注意力,提升超图神经网络性能
Overlap-aware meta-learning attention to enhance hypergraph neural networks for node classification
- 融合结构与特征相似性的双模注意力机制
- 在6个数据集上优于9种主流方法,显著提升分类准确率
- 适合处理高重叠复杂关系的节点分类任务
尽管超图神经网络(HGNN)已成为分析复杂数据的强大框架,但其实际表现常受限。一方面,现有模型多采用单一注意力机制,仅关注结构或特征相似性;另一方面,假设所有节点重叠程度相同会导致泛化能力下降。为此,我们提出重叠感知的元学习注意力框架(OMA-HGNN)。首先,设计一种整合结构与特征相似性的超图注意力机制,通过加权组合两类损失来优化模型。其次,根据节点重叠水平划分多任务,并引入多任务元权重网络(MWN)自适应确定权重。第三,内外模型联合训练:内部MWN生成权重,外部HGNN利用这些权重反向优化。在六个真实世界数据集上评估,对比九种先进方法,结果表明OMA-HGNN在学习优质节点表示方面表现优异,显著超越基线。
原文摘要 · Abstract (English)
Although hypergraph neural networks (HGNNs) have emerged as a powerful framework for analyzing complex datasets, their practical performance often remains limited. On one hand, existing networks typically employ a single type of attention mechanism, focusing on either structural or feature similarities during message passing. On the other hand, assuming that all nodes in current hypergraph models have the same level of overlap may lead to suboptimal generalization. To overcome these limitations, we propose a novel framework, overlap-aware meta-learning attention for hypergraph neural networks (OMA-HGNN). First, we introduce a hypergraph attention mechanism that integrates both structural and feature similarities. Specifically, we linearly combine their respective losses with weighted factors for the HGNN model. Second, we partition nodes into different tasks based on their diverse overlap levels and develop a multi-task Meta-Weight-Net (MWN) to determine the corresponding weighted factors. Third, we jointly train the internal MWN model with the losses from the external HGNN model and train the external model with the weighted factors from the internal model. To evaluate the effectiveness of OMA-HGNN, we conducted experiments on six real-world datasets and benchmarked its perfor-mance against nine state-of-the-art methods for node classification. The results demonstrate that OMA-HGNN excels in learning superior node representations and outperforms these baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。