arXiv:2510.03432cs.LG2025-10中稿 · ICDM 2025

通过批量视图聚合提升异构图集成学习性能

LHGEL: Large Heterogeneous Graph Ensemble Learning using Batch View Aggregation

  • 批量采样生成多个图视图,融合多视角信息
  • 残差注意力机制显著提升基学习器准确率
  • 适合处理大规模异构图,尤其在节点类型多样时优势明显

大规模异构图学习面临网络规模大、节点与边类型多样、特征差异显著及局部结构复杂等挑战。本文提出LHGEL框架,采用集成学习策略,在不同采样条件下训练多个图学习器,以捕捉图异构性的多方面特性。核心创新包括批量视图聚合、残差注意力和多样性正则化:批量视图聚合通过子图采样构建多视图;残差注意力自适应加权各视图贡献,引导节点嵌入聚焦于信息丰富的子图,提升基学习器精度;多样性正则化促使不同视图生成的嵌入矩阵具有显著差异,增强模型多样性与集成鲁棒性。理论分析表明,残差注意力可缓解集成学习中的梯度消失问题。在五个真实异构网络上的实验验证了该方法相比现有最优方法有显著性能提升。代码与数据集见https://github.com/Chrisshen12/LHGEL。

原文摘要 · Abstract (English)

Learning from large heterogeneous graphs presents significant challenges due to the scale of networks, heterogeneity in node and edge types, variations in nodal features, and complex local neighborhood structures. This paper advocates for ensemble learning as a natural solution to this problem, whereby training multiple graph learners under distinct sampling conditions, the ensemble inherently captures different aspects of graph heterogeneity. Yet, the crux lies in combining these learners to meet global optimization objective while maintaining computational efficiency on large-scale graphs. In response, we propose LHGEL, an ensemble framework that addresses these challenges through batch sampling with three key components, namely batch view aggregation, residual attention, and diversity regularization. Specifically, batch view aggregation samples subgraphs and forms multiple graph views, while residual attention adaptively weights the contributions of these views to guide node embeddings toward informative subgraphs, thereby improving the accuracy of base learners. Diversity regularization encourages representational disparity across embedding matrices derived from different views, promoting model diversity and ensemble robustness. Our theoretical study demonstrates that residual attention mitigates gradient vanishing issues commonly faced in ensemble learning. Empirical results on five real heterogeneous networks validate that our LHGEL approach consistently outperforms its state-of-the-art competitors by substantial margin. Codes and datasets are available at https://github.com/Chrisshen12/LHGEL.

异构图集成学习图神经网络批量采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。