arXiv:2501.07598cs.LG2025-01被引 2

提出非递归消息传递框架,自动学习异构网络最优聚合路径。

Automated Heterogeneous Network learning with Non-Recursive Message Passing

  • 采用非递归机制避免不同跳数间节点类型混杂带来的噪声
  • 在真实数据集上性能超越现有方法,大尺度数据表现更优
  • 支持可微架构搜索,自动发现高效异构聚合路径,适合复杂网络

异构信息网络(HIN)可建模多种现实系统。由于包含多类型节点、边和特征,直接应用图神经网络(GNN)存在挑战。主要问题有二:一是递归的同质消息传递忽略不同跳数间节点与边的差异,导致无关邻居信息混入,产生噪声;二是不同类型特征需差异化处理,尤其在类型数量庞大时难度更高。为此,本文提出新框架AutoGNR,通过非递归消息传递机制减少噪声干扰,并在该框架下实现可微的神经架构搜索,自动确定最优异构聚合路径。所设计的搜索空间兼顾有效性与计算可行性。实验表明,AutoGNR在常规与大规模真实HIN数据集上均持续优于当前最佳方法。

原文摘要 · Abstract (English)

Heterogeneous information networks (HINs) can be used to model various real-world systems. As HINs consist of multiple types of nodes, edges, and node features, it is nontrivial to directly apply graph neural network (GNN) techniques in heterogeneous cases. There are two remaining major challenges. First, homogeneous message passing in a recursive manner neglects the distinct types of nodes and edges in different hops, leading to unnecessary information mixing. This often results in the incorporation of ``noise'' from uncorrelated intermediate neighbors, thereby degrading performance. Second, feature learning should be handled differently for different types, which is challenging especially when the type sizes are large. To bridge this gap, we develop a novel framework - AutoGNR, to directly utilize and automatically extract effective heterogeneous information. Instead of recursive homogeneous message passing, we introduce a non-recursive message passing mechanism for GNN to mitigate noise from uncorrelated node types in HINs. Furthermore, under the non-recursive framework, we manage to efficiently perform neural architecture search for an optimal GNN structure in a differentiable way, which can automatically define the heterogeneous paths for aggregation. Our tailored search space encompasses more effective candidates while maintaining a tractable size. Experiments show that AutoGNR consistently outperforms state-of-the-art methods on both normal and large scale real-world HIN datasets.

异构网络图神经网络消息传递架构搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。