arXiv:2510.10849cs.LG2025-10被引 3

让大模型只在需要时介入,提升图神经网络在异质节点上的表现。

Glance for Context: Learning When to Leverage LLMs for Node-Aware GNN-LLM Fusion

  • 按节点动态决定是否调用大模型,仅对薄弱节点优化
  • 异质节点性能提升最高达13%,整体表现最优
  • 轻量路由机制实现高效部署,适合大规模图数据

文本属性图上的学习推动了大语言模型(LLMs)在图学习中的应用。然而,多数融合策略对所有节点统一使用,整体性能提升有限。我们指出,这是由于聚合指标掩盖了大模型实际发挥作用的节点,阻碍了新策略的设计。本文重新聚焦于图神经网络(GNN)通常表现不佳的节点,发现GNN与大模型在不同结构模式下各有优势,如局部同质性。为此,提出GLANCE框架,通过轻量级路由机制,基于每个节点的简单信号判断是否调用大模型以修正预测。由于大模型调用不可微,路由模块采用基于优势的目标进行训练,比较调用大模型与仅依赖GNN的收益。在多个基准测试中,GLANCE在不同节点子组间取得最佳性能平衡,在异质节点上性能提升最高达+13%,同时保持全局最优表现。结果表明,自适应、节点感知的GNN-LLM架构具有重要价值,选择性调用大模型可在不增加高计算成本的前提下实现大规模图的可扩展部署。

原文摘要 · Abstract (English)

Learning on text-attributed graphs has motivated the use of Large Language Models (LLMs) for graph learning. However, most fusion strategies are applied uniformly across all nodes and attain only small overall performance gains. We argue this result stems from aggregate metrics that obscure when LLMs provide benefit, inhibiting actionable signals for new strategies. In this work, we reframe LLM-GNN fusion around nodes where GNNs typically falter. We first show that performance can significantly differ between GNNs and LLMs, with each excelling on distinct structural patterns, such as local homophily. To leverage this finding, we propose GLANCE (GNN with LLM Assistance for Neighbor- and Context-aware Embeddings), a framework that invokes an LLM to refine a GNN's prediction. GLANCE employs a lightweight router that, given inexpensive per-node signals, decides whether to query the LLM. Since the LLM calls are non-differentiable, the router is trained with an advantage-based objective that compares the utility of querying the LLM against relying solely on the GNN. Across multiple benchmarks, GLANCE achieves the best performance balance across node subgroups, achieving significant gains on heterophilous nodes (up to $+13\%$) while simultaneously achieving top overall performance. Our findings highlight the value of adaptive, node-aware GNN-LLM architectures, where selectively invoking the LLM enables scalable deployment on large graphs without incurring high computational costs.

GNN大模型图学习自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。