arXiv:2503.00750cs.LGcs.AI2025-03ICLR被引 20

通过优化图的边来提升GNN下游任务表现,无需微调模型。

Edge Prompt Tuning for Graph Neural Networks

  • 在边层面学习提示向量,通过消息传递融入预训练GNN。
  • 在10个数据集上超越6个基线方法,提升节点和图分类性能。
  • 适配多种预训练GNN架构,适用于各类下游任务。

近年来,利用无标签图数据进行自监督预训练已成为构建强大图神经网络(GNN)的主流方法。然而,预训练与下游任务之间常存在目标差距。为弥合这一差距,图提示调优技术通过修改输入图或重构下游任务为预训练任务,不微调预训练模型即可实现适应。尽管现有方法有效,但忽视了边在提示设计中的关键作用,而边对下游任务的图表示质量有显著影响。本文提出EdgePrompt,一种从边视角出发的简单且高效的图提示调优方法。不同于以往在节点特征上设计提示向量的做法,EdgePrompt通过学习边的额外提示向量来操控输入图,并将这些边提示通过预训练GNN的消息传递机制融合,以更好地嵌入图结构信息。该方法兼容多种预训练策略下的主流GNN架构,适用于不同下游任务。我们提供了针对节点分类和图分类任务的理论分析。在四种预训练策略下对10个图数据集的广泛实验表明,所提方法优于6个基线。代码已开源:https://github.com/xbfu/EdgePrompt。

原文摘要 · Abstract (English)

Pre-training powerful Graph Neural Networks (GNNs) with unlabeled graph data in a self-supervised manner has emerged as a prominent technique in recent years. However, inevitable objective gaps often exist between pre-training and downstream tasks. To bridge this gap, graph prompt tuning techniques design and learn graph prompts by manipulating input graphs or reframing downstream tasks as pre-training tasks without fine-tuning the pre-trained GNN models. While recent graph prompt tuning methods have proven effective in adapting pre-trained GNN models for downstream tasks, they overlook the crucial role of edges in graph prompt design, which can significantly affect the quality of graph representations for downstream tasks. In this study, we propose EdgePrompt, a simple yet effective graph prompt tuning method from the perspective of edges. Unlike previous studies that design prompt vectors on node features, EdgePrompt manipulates input graphs by learning additional prompt vectors for edges and incorporates the edge prompts through message passing in the pre-trained GNN models to better embed graph structural information for downstream tasks. Our method is compatible with prevalent GNN architectures pre-trained under various pre-training strategies and is universal for different downstream tasks. We provide comprehensive theoretical analyses of our method regarding its capability of handling node classification and graph classification as downstream tasks. Extensive experiments on ten graph datasets under four pre-training strategies demonstrate the superiority of our proposed method against six baselines. Our code is available at https://github.com/xbfu/EdgePrompt.

图神经网络提示调优边建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。