针对复杂图结构的提示调优难题,提出分布感知的图提示方法
DAGPrompT: Pushing the Limits of Graph Prompting with a Distribution-aware Graph Prompt Tuning Approach
- 引入分层提示与低秩适配,动态匹配不同邻域分布
- 在10个数据集上最高提升4.79%准确率,超越14种基线方法
- 适合处理异质性高、结构复杂的图学习任务
预训练后微调范式虽能捕捉通用知识,但预训练与下游任务间存在目标差异,限制其效果。现有图提示方法通过任务重构和可学习提示试图弥合差距,但在异质性图等复杂图结构上表现不佳。冻结GNN编码器会削弱提示影响,而简单提示无法应对多跳分布差异。本文识别出两大挑战:一是在下游任务中适应新分布以缓解异质性带来的偏差;二是为不同跳数节点定制提示。为此提出分布感知图提示调优(DAGPrompT),结合GLoRA模块优化编码器投影矩阵与消息传递机制,并引入分跳提示以适应不同图结构和分布。在10个数据集与14个基线上的评估显示,DAGPrompT在节点与图分类任务中最高提升4.79%准确率,达到新最优性能,同时保持高效。代码已开源。
原文摘要 · Abstract (English)
The pre-train then fine-tune approach has advanced GNNs by enabling general knowledge capture without task-specific labels. However, an objective gap between pre-training and downstream tasks limits its effectiveness. Recent graph prompting methods aim to close this gap through task reformulations and learnable prompts. Despite this, they struggle with complex graphs like heterophily graphs. Freezing the GNN encoder can reduce the impact of prompting, while simple prompts fail to handle diverse hop-level distributions. This paper identifies two key challenges in adapting graph prompting methods for complex graphs: (1) adapting the model to new distributions in downstream tasks to mitigate pre-training and fine-tuning discrepancies from heterophily and (2) customizing prompts for hop-specific node requirements. To overcome these challenges, we propose Distribution-aware Graph Prompt Tuning (DAGPrompT), which integrates a GLoRA module for optimizing the GNN encoder's projection matrix and message-passing schema through low-rank adaptation. DAGPrompT also incorporates hop-specific prompts accounting for varying graph structures and distributions among hops. Evaluations on 10 datasets and 14 baselines demonstrate that DAGPrompT improves accuracy by up to 4.79 in node and graph classification tasks, setting a new state-of-the-art while preserving efficiency. Codes are available at GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。