提升知识图谱实体对齐精度,解决命名差异与局部信息不足问题
Predicate Importance Estimation and Decoupled Rationale-Score Distillation for Entity Alignment

- 基于无主语三元组构建谓词感知的实体嵌入
- 小模型通过伪答案训练获得任务推理能力,信心得分更稳定
- 分离判断与置信度,支持人工审核不确定结果
知识图谱(KG)正被广泛用于大型语言模型(LLM)的结构化上下文,但工业级KG-RAG系统需融合来自异构数据库的公开与领域特定知识图谱。这一融合依赖于实体对齐(EA),而仅靠词汇匹配在谓词名称变化和局部邻居不完整时效果不佳。本文构建了一个成对实体对齐数据集,并提出两个互补模块:谓词重要性估计(PIE)与解耦推理-得分蒸馏(DRSD)。PIE是一种轻量嵌入方法,将每个一跳三元组中的主语移除,编码无主语三元组,并通过可学习的谓词重要性权重聚合,生成谓词感知的实体嵌入。DRSD利用教师大模型生成伪答案,通过不同提示训练一个小型语言模型(SLM),将二分类标签转化为文本监督,同时解耦置信度得分与标签一致的推理过程,使小模型学会任务特定推理并保持较弱标签偏倚的信心信号。实验表明,PIE与DRSD均提升了实体对齐分类性能。此外,由于DRSD分离了置信度与决策,两者之间的差异可标记为不确定预测,便于人工介入审查,实现自动接受与人工复核间的实际差分。
原文摘要 · Abstract (English)
Knowledge graphs (KGs) are increasingly used as structured context for Large Language Models (LLMs), but industrial KG-RAG systems often need to integrate public and domain-specific KGs constructed from heterogeneous databases. This integration relies on Entity Alignment (EA), where lexical matching alone is insufficient under predicate-name variation and incomplete local neighborhoods. We address EA for KG integration by constructing a pairwise EA dataset and proposing two complementary modules: Predicate Importance Estimation (PIE) and Decoupled Rationale-Score Distillation (DRSD). PIE is a compact embedding-based approach that removes the subject information from each 1-hop triple, encodes the resulting subjectless triples, and aggregates them with learnable predicate-importance weights to build predicate-aware entity embeddings. DRSD trains a distilled small language model (SLM) with pseudo-answers produced by a teacher LLM through distinct prompts. By converting binary EA labels into text-based supervision and decoupling confidence-score estimation from label-consistent rationales, DRSD enables the SLM to learn task-specific reasoning while retaining a less label-biased confidence signal. Experiments show that PIE and DRSD improve EA classification. Moreover, because DRSD decouples confidence-score estimation from the decision, a discrepancy between the two flags an uncertain prediction for human review, thereby enabling a practical discrepancy between automatic acceptance and human-in-the-loop verification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。