arXiv:2508.12244cs.LG2025-08被引 9

首个全面评估超图神经网络的基准,覆盖4大维度22个数据集

DHG-Bench: A Comprehensive Benchmark for Deep Hypergraph Learning

  • 构建四维评估体系:有效性、效率、鲁棒性、公平性
  • 在22个数据集上评测17种先进超图模型,揭示性能优劣
  • 开源易用工具库,支持可复现研究,适配算法开发者

深度图模型在网络表征学习中取得显著进展,但其仅关注成对关系,难以捕捉真实系统中普遍存在的高阶交互,这类关系可自然建模为超图。为此,超图神经网络(HNNs)近年受到广泛关注。尽管已有众多HNN提出,但缺乏统一实验协议与多维度实证分析,制约了研究深入。现有工具包虽能辅助算法评估,但量化结果有限,且对前沿算法、数据集和任务覆盖不足。为此,我们提出DHG-Bench,首个面向HNN的综合性基准。该基准从有效性、效率、鲁棒性、公平性四个维度系统评估17种先进HNN算法,在22个涵盖节点级、边级、图级任务的多样化数据集上采用统一实验设置进行测试。大量实验揭示现有算法的优势与局限,为未来研究提供重要洞见。此外,为促进可复现研究,我们开发了易于使用的训练与评估库,DHG-Bench库已开源:https://github.com/Coco-Hut/DHG-Bench。

原文摘要 · Abstract (English)

Deep graph models have achieved great success in network representation learning. However, their focus on pairwise relationships restricts their ability to learn pervasive higher-order interactions in real-world systems, which can be naturally modeled as hypergraphs. To tackle this issue, Hypergraph Neural Networks (HNNs) have garnered substantial attention in recent years. Despite the proposal of numerous HNNs, the absence of consistent experimental protocols and multi-dimensional empirical analysis impedes deeper understanding and further development of HNN research. While several toolkits for deep hypergraph learning (DHGL) have been introduced to facilitate algorithm evaluation, they provide only limited quantitative evaluation results and insufficient coverage of advanced algorithms, datasets, and benchmark tasks. To fill the gap, we introduce DHG-Bench, the first comprehensive benchmark for HNNs. Specifically, DHG-Bench systematically investigates the characteristics of HNNs in terms of four dimensions: effectiveness, efficiency, robustness, and fairness. We comprehensively evaluate 17 state-of-the-art HNN algorithms on 22 diverse datasets spanning node-, edge-, and graph-level tasks, under unified experimental settings. Extensive experiments reveal both the strengths and limitations of existing algorithms, offering valuable insights and directions for future research. Furthermore, to facilitate reproducible research, we have developed an easy-to-use library for training and evaluating different HNN methods. The DHG-Bench library is available at: https://github.com/Coco-Hut/DHG-Bench.

超图神经网络基准测试可复现研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。