arXiv:2411.06253cs.AI2024-11被引 1

让非专家也能用自然语言编写知识规则,支持复杂推理。

Knowledge Authoring with Factual English, Rules, and Actions

  • 用神经网络解析事实性英文句子,降低使用门槛
  • 在事实、规则和动作上均达到95%以上正确率
  • 适合需要低门槛知识构建的领域专家和开发者

知识表示与推理系统将知识建模为事实和规则的集合,能以复杂方式查询与操作信息。然而,传统KRR技术因需专业技能而难以普及,且现有基于自然语言的系统(如KALM)受限于语言规范,且难以表达规则与动作。为此,本文提出KALMF,通过神经解析器处理事实性英文句子,无需大量语法训练;进一步提出KALMR,支持规则与动作的建模与推理。同时优化了原有系统速度瓶颈。多基准评估显示,本方法在事实与查询构建中正确率达95%,规则构建达100%,动作建模超过99.3%。实验还揭示了当前大模型如ChatGPT在逻辑推理上的局限。新优化使运行时间减少68%,整体准确率提升。

原文摘要 · Abstract (English)

Knowledge representation and reasoning systems represent knowledge as collections of facts and rules. KRRs can represent complex concepts and relations, and they can query and manipulate information in sophisticated ways. Unfortunately, the KRR technology has been hindered by the fact that specifying the requisite knowledge requires skills that most domain experts do not have, and professional knowledge engineers are hard to find. Some recent CNL-based approaches, such as the Knowledge Authoring Logic Machine (KALM), have shown to have very high accuracy compared to others, and a natural question is to what extent the CNL restrictions can be lifted. Besides the CNL restrictions, KALM has limitations in terms of the types of knowledge it can represent. To address these issues, we propose an extension of KALM called KALM for Factual Language (KALMF). KALMF uses a neural parser for natural language, MS, to parse what we call factual English sentences, which require little grammar training to use. Building upon KALMF, we propose KALM for Rules and Actions (KALMR), to represent and reason with rules and actions. Furthermore, we identify the reasons behind the slow speed of KALM and make optimizations to address this issue. Our evaluation using multiple benchmarks shows that our approaches achieve a high level of correctness on fact and query authoring (95%) and on rule authoring (100%). When used for authoring and reasoning with actions, our approach achieves more than 99.3% correctness, demonstrating its effectiveness in enabling more sophisticated knowledge representation and reasoning. We also illustrate the logical reasoning capabilities of our approach by drawing attention to the problems faced by the famous AI, ChatGPT. Finally, the evaluation of the newly proposed speed optimization points not only to a 68% runtime improvement but also yields better accuracy of the overall system.

知识图谱自然语言逻辑推理自动化构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。