arXiv:2411.06688cs.LGstat.ML2024-11被引 3

发现简单欧氏模型在多数情况下优于超球模型,质疑超球图学习的可靠性。

Shedding Light on Problems with Hyperbolic Graph Learning

  • 对比相同参数量的欧氏模型,发现其性能不逊于甚至超越超球模型。
  • 在高双曲性指标(如Gromov δ-超球)的树状数据集上,欧氏模型仍表现更优。
  • 揭示了超球建模中基线缺失、假设错误和度量误导等关键问题。

近期图机器学习文献提出多种超球表示学习方法,声称在节点分类、链接预测等任务上性能提升,并认为某些层级图数据集在几何上更适合嵌入超球空间。然而,我们的研究发现:当使用相同参数量的简单欧氏模型在一致训练环境下充分训练时,大多数情况下其性能与所有已提出的超球表示学习模型相当,甚至更优,即使在先前被认定为最具有超球特性的数据集(基于Gromov δ-超球性度量,即完美树)上也是如此。这一现象引发根本疑问:为何如此?我们深入剖析当前超球图表示学习领域,发现三类问题:基准线设置不严谨、算法构建中存在错误建模假设、以及使用误导性指标衡量图数据几何特性。为此,我们系统分析现有方法,揭示核心缺陷,并引入一个参数化基准数据集族,以评估(超球)图神经网络的实际适用性。

原文摘要 · Abstract (English)

Recent papers in the graph machine learning literature have introduced a number of approaches for hyperbolic representation learning. The asserted benefits are improved performance on a variety of graph tasks, node classification and link prediction included. Claims have also been made about the geometric suitability of particular hierarchical graph datasets to representation in hyperbolic space. Despite these claims, our work makes a surprising discovery: when simple Euclidean models with comparable numbers of parameters are properly trained in the same environment, in most cases, they perform as well, if not better, than all introduced hyperbolic graph representation learning models, even on graph datasets previously claimed to be the most hyperbolic as measured by Gromov $δ$-hyperbolicity (i.e., perfect trees). This observation gives rise to a simple question: how can this be? We answer this question by taking a careful look at the field of hyperbolic graph representation learning as it stands today, and find that a number of results do not diligently present baselines, make faulty modelling assumptions when constructing algorithms, and use misleading metrics to quantify geometry of graph datasets. We take a closer look at each of these three problems, elucidate the issues, perform an analysis of methods, and introduce a parametric family of benchmark datasets to ascertain the applicability of (hyperbolic) graph neural networks.

图神经网络超球几何模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。