arXiv:2503.00476cs.LG2025-03被引 2

构建首个图神经网络开放集识别综合评测基准,解决实际应用中未知类识别难题。

G-OSR: A Comprehensive Benchmark for Graph Open-Set Recognition

  • 设计跨领域多任务图数据集,支持节点与图级别的开放集识别评估
  • 首次统一评测传统方法、OOD检测、异常检测与开放集识别的性能差异
  • 为图学习在真实场景中的鲁棒性研究提供可复现的基准工具

图神经网络(GNN)在社交网络、生物信息学、知识图谱等领域取得显著进展,但现有研究大多假设封闭集环境。在真实开放集场景中,模型因遭遇未见类别而面临鲁棒性与可靠性挑战。为此,亟需图开放集识别(GOSR)方法保障实际应用效果。然而,当前研究仍处于起步阶段,缺乏覆盖多种任务与数据集的综合性评测基准。此外,传统方法如图外分布检测(GOODD)、GOSR与图异常检测(GAD)长期独立发展,彼此关联性未被充分探索。为此,本文提出 extbf{G-OSR},一个涵盖多个领域的节点级与图级别评测基准,支持对传统方法、GOODD、GOSR与GAD方法进行公平、标准化的有效性与效率对比。实验结果揭示了现有GOSR方法的泛化能力与局限性,为该领域系统性研究提供了关键资源与深入分析视角。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) have achieved significant success in machine learning, with wide applications in social networks, bioinformatics, knowledge graphs, and other fields. Most research assumes ideal closed-set environments. However, in real-world open-set environments, graph learning models face challenges in robustness and reliability due to unseen classes. This highlights the need for Graph Open-Set Recognition (GOSR) methods to address these issues and ensure effective GNN application in practical scenarios. Research in GOSR is in its early stages, with a lack of a comprehensive benchmark spanning diverse tasks and datasets to evaluate methods. Moreover, traditional methods, Graph Out-of-Distribution Detection (GOODD), GOSR, and Graph Anomaly Detection (GAD) have mostly evolved in isolation, with little exploration of their interconnections or potential applications to GOSR. To fill these gaps, we introduce \textbf{G-OSR}, a comprehensive benchmark for evaluating GOSR methods at both the node and graph levels, using datasets from multiple domains to ensure fair and standardized comparisons of effectiveness and efficiency across traditional, GOODD, GOSR, and GAD methods. The results offer critical insights into the generalizability and limitations of current GOSR methods and provide valuable resources for advancing research in this field through systematic analysis of diverse approaches.

图神经网络开放集识别评测基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。