arXiv:2606.22429cs.LG2026-06中稿 · ICML

让大模型理解图结构信息,提升零样本图任务性能。

Enhancing LLMs for Graph Tasks via Graph-aware LoRA Generation

论文配图:Enhancing LLMs for Graph Tasks via Graph-aware LoRA Generation
图 1 · 摘自论文原文
  • 通过生成与图结构相关的权重更新,注入全图信息。
  • 在零样本图学习任务中显著优于现有方法。
  • 适合需要跨数据集泛化的图神经网络研究者。

图神经网络(GNN)的输入输出参数与特定数据集的特征空间和目标集合紧密耦合,导致跨数据集迁移能力有限。相比之下,语言模型(LM)通过统一的输入输出接口实现灵活泛化,促使近期研究尝试将语言模型适配到图任务。然而,现有方法难以编码完整的图信息,可能导致信息丢失和图理解不足。本文提出一种新型的权重级信息注入范式,通过生成与任务相关的权重更新,直接与隐藏表示交互,以注入全图信息。基于低秩适应(LoRA)实现该范式,我们提出GaRA模型:它根据原始图结构生成低秩权重更新,并约束生成更新的范数,从而有效注入全图信息并避免权重生成中的优化偏差。实证研究表明,GaRA在零样本图学习任务中持续优于基线方法。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) tightly couple their input-output parameters to dataset-specific feature spaces and target sets, exhibiting limited transferability across different datasets. In contrast, language models (LMs) generalize flexibly via a unified input-output interface, motivating recent attempts to adapt LMs to graph tasks. However, existing methods struggle to encode whole-graph information, leading to potential information loss and suboptimal graph understanding. In this work, we propose a novel weight-level information injection paradigm for adapting LMs to graph tasks. This paradigm injects whole-graph information by generating task-specific weight updates that interact directly with hidden representations. Instantiating this paradigm following low-rank adaptation (LoRA), we introduce GaRA, a Graph-aware LoRA generation model. GaRA constructs low-rank weight updates conditioned on the original graph structures and constrains the norm of the generated updates, thus injecting whole-graph information and avoiding the optimization bias in the weight generation. Empirical studies demonstrate that GaRA consistently outperforms baselines on zero-shot graph learning tasks.

图神经网络大模型LoRA零样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。