arXiv:2503.00547cs.LG2025-03被引 2

GNN在图分类任务中表现差异大,研究发现拓扑与特征共同影响性能,提出针对性优化策略。

Performance Heterogeneity in Graph Neural Networks: Lessons for Architecture Design and Preprocessing

  • 分析图神经网络在图级任务中的性能差异,发现拓扑不足以解释异质性
  • 提出基于树移动距离的联合评估方法,关联类间距离比与性能波动
  • 设计选择性重连和深度自适应策略,适合复杂图数据的模型设计

图神经网络已成为图级学习(如图分类与回归)中最主流的架构,广泛应用于生物化学与药物发现等领域。实际应用中,良好性能依赖精细的模型设计,但因对模型与数据特性关系理解不足,常需人工调参,尤其在图级任务中,输入数据变异远高于节点级任务。为弥补这一差距,本文系统分析了图级任务中的个体性能异质性,发现消息传递与基于Transformer的架构均存在显著性能差异。进一步研究显示,仅靠图拓扑无法解释异质性;通过树移动距离(Tree Mover's Distance),联合评估拓扑与特征信息,揭示类间距离比与性能异质性之间存在关联。据此提出一种选择性重连策略,仅对性能可提升的图进行重构,并发现最优网络深度取决于图的谱特性,由此提出层数选择启发式方法。实验验证了这些设计在实践中的有效性。

原文摘要 · Abstract (English)

Graph Neural Networks have emerged as the most popular architecture for graph-level learning, including graph classification and regression tasks, which frequently arise in areas such as biochemistry and drug discovery. Achieving good performance in practice requires careful model design. Due to gaps in our understanding of the relationship between model and data characteristics, this often requires manual architecture and hyperparameter tuning. This is particularly pronounced in graph-level tasks, due to much higher variation in the input data than in node-level tasks. To work towards closing these gaps, we begin with a systematic analysis of individual performance in graph-level tasks. Our results establish significant performance heterogeneity in both message-passing and transformer-based architectures. We then investigate the interplay of model and data characteristics as drivers of the observed heterogeneity. Our results suggest that graph topology alone cannot explain heterogeneity. Using the Tree Mover's Distance, which jointly evaluates topological and feature information, we establish a link between class-distance ratios and performance heterogeneity in graph classification. These insights motivate model and data preprocessing choices that account for heterogeneity between graphs. We propose a selective rewiring approach, which only targets graphs whose individual performance benefits from rewiring. We further show that the optimal network depth depends on the graph's spectrum, which motivates a heuristic for choosing the number of GNN layers. Our experiments demonstrate the utility of both design choices in practice.

图神经网络性能异质性模型设计图预处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。