arXiv:2507.19526cs.LGcs.AI2025-07KDD被引 5

将图结构转化为离散符号,让大模型直接理解图数据

Quantizing Text-attributed Graphs for Semantic-Structural Integration

  • 用冻结码本对图结构进行软量化,保留拓扑信息
  • 零样本迁移效果超越现有方法,无需源域标签
  • 兼容各类大模型,适合想用大模型做图分析的开发者

文本属性图(TAGs)已成为建模跨领域复杂关系的强大表示。随着大语言模型(LLMs)的发展,如何利用其能力进行图学习成为热点。然而,现有方法在将结构信息嵌入适配LLM的格式时面临挑战,通常需要计算开销大的对齐机制或手动图描述,易丢失关键结构细节。此外,这些方法多依赖源域标注数据进行迁移学习,限制了适应性。本文提出STAG,一种新颖的自监督框架,通过冻结码本将图结构信息直接量化为离散令牌。不同于传统量化,该方法采用软分配与KL散度引导的量化策略,以应对图数据缺乏天然分词结构的特性。该框架支持基于LLM及传统学习方法,并实现真正的零样本迁移,无需源域标注数据。大量实验表明,在多个节点分类基准上达到当前最优性能,同时兼容不同LLM架构,为连接图学习与大模型提供了优雅解决方案。

原文摘要 · Abstract (English)

Text-attributed graphs (TAGs) have emerged as a powerful representation for modeling complex relationships across diverse domains. With the rise of large language models (LLMs), there is growing interest in leveraging their capabilities for graph learning. However, current approaches face significant challenges in embedding structural information into LLM-compatible formats, requiring either computationally expensive alignment mechanisms or manual graph verbalization techniques that often lose critical structural details. Moreover, these methods typically require labeled data from source domains for effective transfer learning, significantly constraining their adaptability. We propose STAG, a novel self-supervised framework that directly quantizes graph structural information into discrete tokens using a frozen codebook. Unlike traditional quantization approaches, our method employs soft assignment and KL divergence guided quantization to address the unique challenges of graph data, which lacks natural tokenization structures. Our framework enables both LLM-based and traditional learning approaches, supporting true zero-shot transfer learning without requiring labeled data even in the source domain. Extensive experiments demonstrate state-of-the-art performance across multiple node classification benchmarks while maintaining compatibility with different LLM architectures, offering an elegant solution to bridging graph learning with LLMs.

图神经网络大模型量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。