HGEN通过元路径与注意力机制提升异构图集成学习效果
HGEN: Heterogeneous Graph Ensemble Networks
- 用元路径和随机丢弃构建多种图神经网络作为基学习器
- 在五个数据集上显著超越现有方法,最高提升8.3%准确率
- 适合研究异构图分析与集成学习的学者参考
本文提出HGEN,首个针对异构图的集成学习框架。异构性体现在节点类型、特征及局部邻域拓扑,给集成学习带来挑战。HGEN通过元路径与随机丢弃构建等位图神经网络(Allele GNNs),并进行训练与对齐以实现集成。关键组件包括:1)残差注意力机制,校准不同元路径的等位GNN,使节点嵌入聚焦更信息丰富的图,提升基学习器性能;2)相关性正则项,扩大不同元路径生成的嵌入矩阵差异,增强基学习器多样性。我们分析了HGEN的收敛性,并证明其正则化强度高于简单投票。在五个异构图数据集上的实验表明,HGEN持续显著优于当前最优方法。
原文摘要 · Abstract (English)
This paper presents HGEN that pioneers ensemble learning for heterogeneous graphs. We argue that the heterogeneity in node types, nodal features, and local neighborhood topology poses significant challenges for ensemble learning, particularly in accommodating diverse graph learners. Our HGEN framework ensembles multiple learners through a meta-path and transformation-based optimization pipeline to uplift classification accuracy. Specifically, HGEN uses meta-path combined with random dropping to create Allele Graph Neural Networks (GNNs), whereby the base graph learners are trained and aligned for later ensembling. To ensure effective ensemble learning, HGEN presents two key components: 1) a residual-attention mechanism to calibrate allele GNNs of different meta-paths, thereby enforcing node embeddings to focus on more informative graphs to improve base learner accuracy, and 2) a correlation-regularization term to enlarge the disparity among embedding matrices generated from different meta-paths, thereby enriching base learner diversity. We analyze the convergence of HGEN and attest its higher regularization magnitude over simple voting. Experiments on five heterogeneous networks validate that HGEN consistently outperforms its state-of-the-art competitors by substantial margin.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。