用大模型把知识图谱逻辑规则翻译成自然语言,让人类更容易理解。
Rule2Text: Natural Language Explanation of Logical Rules in Knowledge Graphs
- 用AMIE算法提取规则,再让大模型生成可读解释。
- 人工评估显示解释准确且清晰,但仍有幻觉问题。
- 适合需要解释推理过程的研究者和开发者。
知识图谱(KG)蕴含丰富信息,可用于推断新事实。发现逻辑规则不仅能提升图谱完整性,还能检测潜在错误、揭示数据模式,并增强推理与解释能力。然而,规则复杂性及各知识图谱独特的命名规范,使人类难以理解。本文探索大语言模型生成逻辑规则自然语言解释的潜力。我们使用AMIE 3.5.1算法从基准数据集FB15k-237及两个大规模数据集FB-CVT-REV和FB+CVT-REV中提取逻辑规则,测试零样本、少样本提示、实体类型注入及思维链推理等多种策略。通过人工评估解释的正确性、清晰度和幻觉情况,并考察大模型作为自动评判者的可行性。结果表明,生成解释在准确性和清晰度上表现良好,但仍存在若干挑战需未来研究解决。本研究所有脚本与数据已公开于https://github.com/idirlab/KGRule2NL。
原文摘要 · Abstract (English)
Knowledge graphs (KGs) often contain sufficient information to support the inference of new facts. Identifying logical rules not only improves the completeness of a knowledge graph but also enables the detection of potential errors, reveals subtle data patterns, and enhances the overall capacity for reasoning and interpretation. However, the complexity of such rules, combined with the unique labeling conventions of each KG, can make them difficult for humans to understand. In this paper, we explore the potential of large language models to generate natural language explanations for logical rules. Specifically, we extract logical rules using the AMIE 3.5.1 rule discovery algorithm from the benchmark dataset FB15k-237 and two large-scale datasets, FB-CVT-REV and FB+CVT-REV. We examine various prompting strategies, including zero- and few-shot prompting, including variable entity types, and chain-of-thought reasoning. We conduct a comprehensive human evaluation of the generated explanations based on correctness, clarity, and hallucination, and also assess the use of large language models as automatic judges. Our results demonstrate promising performance in terms of explanation correctness and clarity, although several challenges remain for future research. All scripts and data used in this study are publicly available at https://github.com/idirlab/KGRule2NL}{https://github.com/idirlab/KGRule2NL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。