arXiv:2512.21106cs.CLcs.AI2025-12被引 6

用图内相似节点引导大模型优化节点语义,提升异构图学习效果。

Semantic Refinement with LLMs for Graph Representations

  • 基于图内相似节点检索,引导大模型精准修正节点描述。
  • 在语义丰富与结构主导的图上均实现性能提升,最高增益达12.3%。
  • 适合处理结构与语义关系不一的真实复杂图数据,如社交网络、知识图谱。

图数据在预测信号来源上存在显著异质性:某些领域中节点语义占主导,另一些则依赖结构模式。这种结构-语义异质性意味着固定归纳偏置的图学习模型难以在多样图域上最优泛化。现有方法多从模型侧引入新归纳偏置,但受限于真实图的开放多样性。本文提出一种以数据为中心的图-原型引导语义精炼(GES)框架,将节点语义视为任务自适应变量。不同于现有基于LLM的方法在无图上下文生成节点描述,本方法利用图内结构与语义相似节点作为原型,指导大模型精炼节点描述。具体而言,先训练一个GNN生成预测状态,结合结构与语义相似性检索图内原型,供LLM用于语义优化。在含文本与无文本图上评估结果表明,在语义丰富与结构主导的图上均有稳定提升,验证了在结构-语义异质性下数据驱动语义精炼的有效性。

原文摘要 · Abstract (English)

Graph-structured data exhibit substantial heterogeneity in where their predictive signals originate: in some domains, node-level semantics dominate, while in others, structural patterns play a central role. This structure-semantics heterogeneity implies that no graph learning model with a fixed inductive bias can generalize optimally across diverse graph domains. However, most existing methods address this challenge from the model side by incrementally injecting new inductive biases, which remains fundamentally limited given the open-ended diversity of real-world graphs. In this work, we take a data-centric perspective and treat node semantics as a task-adaptive variable. We propose a Graph-Exemplar-guided Semantic Refinement (GES) framework for graph representation learning which -- unlike existing LLM-enhanced methods that generate node descriptions without graph context -- leverages structurally and semantically similar nodes from the graph itself to guide semantic refinement. Specifically, a GNN is first trained to produce predictive states, which along with structural and semantic similarity are used to retrieve in-graph exemplars that inform an LLM in refining node descriptions. We evaluate our approach on both text-rich and text-free graphs. Results show consistent improvements on semantics-rich and structure-dominated graphs, demonstrating the effectiveness of data-centric semantic refinement under structure-semantics heterogeneity.

图神经网络大模型语义精炼

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。