arXiv:2606.03290cs.LGcs.AI2026-06中稿 · ICML

提出新理论证明消息调优超越图提示调优上限

Message Tuning Outshines Graph Prompt Tuning: A Prismatic Space Perspective

  • 构建普适空间理论量化模型适应能力
  • 消息调优在多个数据集上全面超越基线
  • 适合研究图神经网络适配机制的学者

图基础模型(GFMs)基于预训练与微调范式,已成为图学习领域的研究热点。针对基于GNN的GFMs,图提示调优已成为主流的下游任务适配方法。尽管已有研究尝试解释其有效性,但如何严格衡量其适应能力仍是一个开放问题。本文提出普适空间理论(PS-Theory),一种新颖的数学框架,用于量化适配方法的能力,并重点建立图提示调优的适应能力上限。基于该理论,我们进一步提出消息调优(MTG),一种轻量级方法,在GNN每层注入少量可学习的消息原型,以自适应引导消息融合,无需更新预训练权重。通过PS-Theory,我们证明了MTG的适应能力可突破图提示调优的理论上限。大量实验表明,MTG在多个基准数据集上持续优于图提示调优基线,为理论发现提供了强有力的实证支持。

原文摘要 · Abstract (English)

Graph Foundation Models (GFMs), built upon the Pre-training and Adaptation paradigm, have emerged as a research hotspot in graph learning. For GNN-based GFMs, graph prompt tuning has become the prevailing adaptation method for downstream tasks. Although recent methods explain why graph prompt tuning works, how to rigorously measure its adaptation capacity remains an open problem. Addressing this problem is critical for understanding the capability limits of graph prompt tuning and for developing more powerful adaptation methods. In this paper, we propose Prismatic Space Theory (PS-Theory), a novel mathematical framework to quantify the capacity of adaptation methods, while focusing on establishing the upper bound for the adaptation capacity of graph prompt tuning. Building upon the proposed PS-Theory, we further introduce Message Tuning for GFMs (MTG), a lightweight approach that injects a small set of learnable message prototypes into each layer of the GNN backbone to adaptively guide message fusion without updating pre-trained weights. Through our PS-Theory, we prove that the adaptation capacity of MTG can exceed the theoretical upper bound of graph prompt tuning. Extensive experiments demonstrate that MTG consistently outperforms graph prompt baselines across diverse benchmark datasets, providing strong empirical support for our theoretical findings.

图神经网络模型适配理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。