用隐式方程建模超图关系,稳定捕捉长程依赖。
Implicit Hypergraph Neural Networks: A Stable Framework for Higher-Order Relational Learning with Provable Guarantees
- 不堆叠层数,通过非线性不动点方程实现全局传播
- 在引用数据集上准确率超越传统模型,且对初始化不敏感
- 理论保证收敛性与泛化能力,适合高阶关系学习场景
真实世界中的交互多为群体而非成对关系,如多作者论文和用户共同评分。超图神经网络在建模高阶关系方面表现优异,但依赖固定层数的消息传递机制限制了长程依赖捕捉,且深度增加时训练易不稳定。本文提出隐式超图神经网络(IHGNN),将隐式平衡公式引入超图:不通过堆叠层,而是将表示计算为非线性不动点方程的解,实现无需深层结构的稳定高效全局传播。我们设计了有理论保障的训练方案,证明了收敛性,分析了过平滑条件与模型表达能力,并推导出超图上的归纳泛化界。进一步提出基于投影的隐式梯度训练与稳定策略。在引用基准数据集上的大量实验表明,IHGNN在准确率与鲁棒性上持续优于强基线模型。实证显示其对随机初始化和超参数变化具有韧性,凸显其在高阶关系学习中的强泛化能力与实用价值。
原文摘要 · Abstract (English)
Many real-world interactions are group-based rather than pairwise such as papers with multiple co-authors and users jointly engaging with items. Hypergraph neural networks have shown great promise at modeling higher-order relations, but their reliance on a fixed number of explicit message-passing layers limits long-range dependency capture and can destabilize training as depth grows. In this work, we introduce Implicit Hypergraph Neural Networks (IHGNN), which bring the implicit equilibrium formulation to hypergraphs: instead of stacking layers, IHGNN computes representations as the solution to a nonlinear fixed-point equation, enabling stable and efficient global propagation across hyperedges without deep architectures. We develop a well-posed training scheme with provable convergence, analyze the oversmoothing conditions and expressivity of the model, and derive a transductive generalization bound on hypergraphs. We further present an implicit-gradient training procedure coupled with a projection-based stabilization strategy. Extensive experiments on citation benchmarks show that IHGNN consistently outperforms strong traditional graph/hypergraph neural network baselines in both accuracy and robustness. Empirically, IHGNN is resilient to random initialization and hyperparameter variation, highlighting its strong generalization and practical value for higher-order relational learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。