arXiv:2601.08187cs.AI2026-01

通过融合结构与语义同质性,压缩图数据提升大模型推理稳定性。

Improving LLM Reasoning with Homophily-aware Structural and Semantic Text-Attributed Graph Compression

  • 基于结构熵最小化与同质性识别,分层压缩图结构
  • 压缩后输入使大模型推理准确率提升,压缩率更高
  • 适合需要高效图理解的大模型应用

大语言模型(LLMs)在文本属性图(TAG)理解方面展现出潜力。现有方法多依赖手工提示,将目标节点及其邻域上下文输入模型,但受限于上下文窗口,常采用随机采样(如随机丢弃节点/边),引入噪声并导致推理不稳定。本文认为图结构蕴含丰富结构与语义信息,有效利用可提升模型推理性能。为此,提出针对大模型的同质性感知结构与语义压缩框架HS2C:结构上,基于结构熵最小化进行全局层次划分,识别自然凝聚的同质社区并剔除随机连接噪声;语义上,将检测到的同质性传递给模型,使其按预定义社区类型进行差异化语义聚合,将冗余背景信息压缩为社区级共识,仅保留与目标节点语义同质的信息。在10个节点级基准测试中,不同规模和家族的多种大模型验证了该方法能同时提高压缩率与下游推理准确率。扩展至7个多样化的图级任务进一步证明其任务泛化能力。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated promising capabilities in Text-Attributed Graph (TAG) understanding. Recent studies typically focus on verbalizing the graph structures via handcrafted prompts, feeding the target node and its neighborhood context into LLMs. However, constrained by the context window, existing methods mainly resort to random sampling, often implemented via dropping node/edge randomly, which inevitably introduces noise and cause reasoning instability. We argue that graphs inherently contain rich structural and semantic information, and that their effective exploitation can unlock potential gains in LLMs reasoning performance. To this end, we propose Homophily-aware Structural and Semantic Compression for LLMs (HS2C), a framework centered on exploiting graph homophily. Structurally, guided by the principle of Structural Entropy minimization, we perform a global hierarchical partition that decodes the graph's essential topology. This partition identifies naturally cohesive, homophilic communities, while discarding stochastic connectivity noise. Semantically, we deliver the detected structural homophily to the LLM, empowering it to perform differentiated semantic aggregation based on predefined community type. This process compresses redundant background contexts into concise community-level consensus, selectively preserving semantically homophilic information aligned with the target nodes. Extensive experiments on 10 node-level benchmarks across LLMs of varying sizes and families demonstrate that, by feeding LLMs with structurally and semantically compressed inputs, HS2C simultaneously enhances the compression rate and downstream inference accuracy, validating its superiority and scalability. Extensions to 7 diverse graph-level benchmarks further consolidate HS2C's task generalizability.

图神经网络大模型推理结构压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。