arXiv:2602.22698cs.CLcs.AI2026-02

用专用实体标记解决大模型与知识图谱粒度不匹配问题

Tokenization, Fusion and Decoupling: Bridging the Granularity Mismatch Between Large Language Models and Knowledge Graphs

  • 引入专用实体标记构建细粒度特征表示
  • 融合结构与文本特征,实现全空间预测
  • 分离语义与结构推理,提升知识图谱补全效果

利用大语言模型(LLMs)进行知识图谱补全(KGC)具有前景,但受限于根本性的粒度不匹配:LLMs处理碎片化标记序列,而知识图谱(KGs)以实体为基本单位。现有方法通常将预测限制在有限候选集,或通过合并多个标记或分解实体为固定长度标记序列来对齐词汇表,难以同时捕捉文本语义与图结构完整性。为此,我们提出KGT框架,采用专用实体标记实现高效全空间预测。首先,通过专门的标记化构建专用实体标记级别的特征表示;然后,通过关系引导门控机制融合预训练的结构与文本特征,避免从头训练;最后,采用解耦预测,利用独立头分离并组合语义与结构推理。实验表明,KGT在多个基准测试中持续优于现有先进方法。

原文摘要 · Abstract (English)

Leveraging Large Language Models (LLMs) for Knowledge Graph Completion (KGC) is promising but hindered by a fundamental granularity mismatch. LLMs operate on fragmented token sequences, whereas entities are the fundamental units in knowledge graphs (KGs) scenarios. Existing approaches typically constrain predictions to limited candidate sets or align entities with the LLM's vocabulary by pooling multiple tokens or decomposing entities into fixed-length token sequences, which fail to capture both the semantic meaning of the text and the structural integrity of the graph. To address this, we propose KGT, a novel framework that uses dedicated entity tokens to enable efficient, full-space prediction. Specifically, we first introduce specialized tokenization to construct feature representations at the level of dedicated entity tokens. We then fuse pre-trained structural and textual features into these unified embeddings via a relation-guided gating mechanism, avoiding training from scratch. Finally, we implement decoupled prediction by leveraging independent heads to separate and combine semantic and structural reasoning. Experimental results show that KGT consistently outperforms state-of-the-art methods across multiple benchmarks.

知识图谱大模型实体对齐多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。