发现多数图数据集仅靠特征就能达到好效果,质疑图结构必要性。
Revisiting the Necessity of Graph Learning and Common Graph Benchmarks
- 用纯特征MLP对比图模型,五数据集性能差距小
- 特征本身已含足够图信息,削弱了图结构作用
- 提出新合成数据集和真实数据子集作更合理基准
图机器学习自深度学习引入以来迅猛发展,广泛应用于大规模工业场景。传统假设认为图结构与节点特征分离:特征表征个体信息,结构仅反映成对关系。普遍信念是特征本身不足以完成任务,因此基准性能提升可归功于图学习进步。本文挑战这一共识,发现多数常见图基准中,节点特征往往已足够,打破该假设。在七个主流图数据集上对比调优后的特征仅用MLP的基线,五个数据集使用图结构几乎无收益。我们指出这些数据集不需图学习,因特征已包含足够图信息,可大幅减少或消除对图结构的依赖。通过特征分析,揭示特征如何缩小MLP与图方法的性能差距。为改进图神经网络的评估,我们提出一个需要图信息才能取得非平凡性能的参数化合成数据族。最后,筛选出一组真实数据集,其无法被MLP轻易解决,适合作为图神经网络的有效基准。
原文摘要 · Abstract (English)
Graph machine learning has enjoyed a meteoric rise in popularity since the introduction of deep learning in graph contexts. This is no surprise due to the ubiquity of graph data in large scale industrial settings. Tacitly assumed in all graph learning tasks is the separation of the graph structure and node features: node features strictly encode individual data while the graph structure consists only of pairwise interactions. The driving belief is that node features are (by themselves) insufficient for these tasks, so benchmark performance accurately reflects improvements in graph learning. In our paper, we challenge this orthodoxy by showing that, surprisingly, node features are oftentimes more-than-sufficient for many common graph benchmarks, breaking this critical assumption. When comparing against a well-tuned feature-only MLP baseline on seven of the most commonly used graph learning datasets, one gains little benefit from using graph structure on five datasets. We posit that these datasets do not benefit considerably from graph learning because the features themselves already contain enough graph information to obviate or substantially reduce the need for the graph. To illustrate this point, we perform a feature study on these datasets and show how the features are responsible for closing the gap between MLP and graph-method performance. Further, in service of introducing better empirical measures of progress for graph neural networks, we present a challenging parametric family of principled synthetic datasets that necessitate graph information for nontrivial performance. Lastly, we section out a subset of real-world datasets that are not trivially solved by an MLP and hence serve as reasonable benchmarks for graph neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。