arXiv:2510.22451cs.LGcs.AI2025-10NeurIPS被引 3

通过修改图结构来提升预训练GNN的下游性能,比传统方法更有效。

GraphTOP: Graph Topology-Oriented Prompting for Graph Neural Networks

  • 将图结构提示转化为多跳子图的边重连问题,连续优化并保持稀疏性。
  • 在5个数据集上优于6个基线,在多种预训练策略下表现稳健。
  • 适合需要高效微调GNN模型的研究者或工程应用者。

图神经网络(GNN)通过从海量图数据中学习表达性图表示,彻底改变了图学习领域。常见的“预训练-适配”范式先在无标签图数据上预训练GNN,再将其适配到具体下游任务。在适配阶段,图提示是一种有效策略:通过可学习提示修改输入图数据,同时冻结预训练的GNN模型。现有研究多聚焦于特征导向的提示方法,仅作用于节点特征或隐藏表示,但常因忽略拓扑导向提示而表现不佳。本文首次系统研究基于图拓扑的提示机制,提出首个图拓扑导向提示框架GraphTOP。我们将其建模为多跳局部子图内的边重连问题,并通过重新参数化将其松弛至连续概率空间,兼顾紧致性与图稀疏性。在五个图数据集上,采用四种预训练策略的实验表明,GraphTOP在多个节点分类任务中超越六种基线方法。代码已开源:https://github.com/xbfu/GraphTOP。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) have revolutionized the field of graph learning by learning expressive graph representations from massive graph data. As a common pattern to train powerful GNNs, the "pre-training, adaptation" scheme first pre-trains GNNs over unlabeled graph data and subsequently adapts them to specific downstream tasks. In the adaptation phase, graph prompting is an effective strategy that modifies input graph data with learnable prompts while keeping pre-trained GNN models frozen. Typically, existing graph prompting studies mainly focus on *feature-oriented* methods that apply graph prompts to node features or hidden representations. However, these studies often achieve suboptimal performance, as they consistently overlook the potential of *topology-oriented* prompting, which adapts pre-trained GNNs by modifying the graph topology. In this study, we conduct a pioneering investigation of graph prompting in terms of graph topology. We propose the first **Graph** **T**opology-**O**riented **P**rompting (GraphTOP) framework to effectively adapt pre-trained GNN models for downstream tasks. More specifically, we reformulate topology-oriented prompting as an edge rewiring problem within multi-hop local subgraphs and relax it into the continuous probability space through reparameterization while ensuring tight relaxation and preserving graph sparsity. Extensive experiments on five graph datasets under four pre-training strategies demonstrate that our proposed GraphTOP outshines six baselines on multiple node classification datasets. Our code is available at https://github.com/xbfu/GraphTOP.

图神经网络提示学习拓扑优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。