让图模型在测试时自适应调整,提升跨领域泛化能力
GFMate: Empowering Graph Foundation Models with Test-time Prompt Tuning

- 测试时引入中心点和层级提示,避开预训练依赖
- 利用标签与无标签数据联合优化,最高提升30.63%
- 适合需要快速适配新领域的图模型应用
图提示调优在传统单领域场景中展现巨大潜力,通过可训练提示增强模型性能。近期研究将图提示扩展至图基础模型(GFMs),通过少量样本调优辅助提示。然而,现有方法多将源域信息嵌入提示,这些提示或作为输入,或在预训练阶段编码,导致与特定源域及预训练策略耦合,限制了其在其他领域和不同GFMs上的泛化能力。此外,现有提示仅依赖少量样本进行适应,忽略了目标域未标记数据中的丰富信息。为此,本文提出无需预训练依赖的测试时图提示调优方法GFMate。GFMate在预训练后于目标域引入中心点和层级提示,避免与特定源域及预训练策略的纠缠。同时设计测试时互补学习目标,充分利用目标域的有标签与无标签数据,实现高效测试时提示调优。在12个基准数据集上的大量实验表明,GFMate表现优异且高效,最高提升达30.63%。代码已公开于https://github.com/YanJiangJerry/GFMate。
原文摘要 · Abstract (English)
Graph prompt tuning has shown great potential in graph learning by introducing trainable prompts to enhance the model performance in conventional single-domain scenarios. Recent research has extended graph prompts to improve Graph Foundation Models (GFMs) by few-shot tuning auxiliary prompts. Despite their progress, most existing methods embed source-domain information into prompts, which serve either as input to GFMs or encoded during model pre-training. Such prompt entanglement with specific source domains and GFM pre-training strategy restricts their generalisability to other domains and different GFMs. Furthermore, existing GFM prompts merely rely on few-shot tuning for adaptation, neglecting the rich information in unlabelled target domain test data. Motivated by these insights, this paper aims to empower GFMs with pre-training-agnostic test-time graph prompt tuning, named GFMate. GFMate introduces centroid and layer prompts applied after pre-training on target domains, avoiding entanglement with specific source domains and model pre-training. In addition, a test-time complementary learning objective is devised to exploit both labelled and unlabelled target domain data for effective test-time prompt tuning. Extensive experiments on 12 benchmark datasets demonstrate the superior performance and efficiency of GFMate, achieving improvements of up to 30.63%. Code is available at https://github.com/YanJiangJerry/GFMate.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。