提出隐式超图网络,解决长程依赖导致性能下降问题
Implicit Hypergraph Neural Network
- 通过隐式微分联合学习节点与超边的固定点表示
- 在真实超图上节点分类任务中超越已有方法,实现新基准
- 适合关注超图建模与长程依赖的科研人员
超图能有效刻画实体间的高阶关系,广泛应用于医疗、社交网络和生物信息学等领域。超图神经网络通过节点与超边间消息传递学习潜在表示,但通常仅进行少量消息传递轮次,导致仅捕捉局部信息而忽略长程高阶依赖。我们发现,盲目增加消息传递轮次虽可获取更多信息,却会降低模型性能。现有隐式图神经网络可在标准图中捕捉长程依赖并保持性能,但该机制尚未被研究于超图神经网络。本文首次揭示现有超图神经网络在聚合更多信息时预测能力下降的问题,并提出隐式超图神经网络(IHNN),通过隐式微分实现端到端的节点与超边固定点表示联合学习。利用可计算的投影梯度下降法,模型训练高效。在多个真实世界超图的节点分类任务中,IHNN显著优于基线方法,建立新的超图学习基准。
原文摘要 · Abstract (English)
Hypergraphs offer a generalized framework for capturing high-order relationships between entities and have been widely applied in various domains, including healthcare, social networks, and bioinformatics. Hypergraph neural networks, which rely on message-passing between nodes over hyperedges to learn latent representations, have emerged as the method of choice for predictive tasks in many of these domains. These approaches typically perform only a small number of message-passing rounds to learn the representations, which they then utilize for predictions. The small number of message-passing rounds comes at a cost, as the representations only capture local information and forego long-range high-order dependencies. However, as we demonstrate, blindly increasing the message-passing rounds to capture long-range dependency also degrades the performance of hyper-graph neural networks. Recent works have demonstrated that implicit graph neural networks capture long-range dependencies in standard graphs while maintaining performance. Despite their popularity, prior work has not studied long-range dependency issues on hypergraph neural networks. Here, we first demonstrate that existing hypergraph neural networks lose predictive power when aggregating more information to capture long-range dependency. We then propose Implicit Hypergraph Neural Network (IHNN), a novel framework that jointly learns fixed-point representations for both nodes and hyperedges in an end-to-end manner to alleviate this issue. Leveraging implicit differentiation, we introduce a tractable projected gradient descent approach to train the model efficiently. Extensive experiments on real-world hypergraphs for node classification demonstrate that IHNN outperforms the closest prior works in most settings, establishing a new state-of-the-art in hypergraph learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。