通过对话挖掘专家知识,构建可形式化验证的知识库。
Elenchus: Generating Knowledge Bases from Prover-Skeptic Dialogues
- 用对话方式让专家与大模型辩论,显化知识中的推理关系。
- 单次对话即可生成符合领域设计逻辑的结构化知识基底。
- 适合需要严谨知识建模的领域,如数据溯源与系统设计。
我们提出Elenchus,一种基于推论语义的知识库构建对话系统,将知识工程重新定义为对专家立场的显性化,而非从文本或专家证词中提取。人类专家通过与大语言模型(LLM)对手进行正反方对话,确立关于某主题的承诺与否认。LLM提出张力(即立场中存在逻辑不一致的命题),专家通过撤回、修正或反驳来解决。由此,LLM作为可质疑的推导判定器,其不可靠性由专家权威结构化地约束。核心技术贡献是将Elenchus的辩证状态映射至Hlobil与Brandom的非单调多后件(NMMS)逻辑中的物质基础,满足包含性,并能显性表达对话中协商的推理关系。我们在W3C PROV-O溯源本体上验证该方法:一次对话即揭示并组织了领域专家可阐述的设计张力,对应于对本体设计的回顾性分析。使用pyNMMS自动推理器,我们验证所得物质基础的结构特性(非传递性、非单调性、独立性)与具体PROV设计理由一致,实现从对话到形式推理的端到端整合。
原文摘要 · Abstract (English)
We present Elenchus, a dialogue system for knowledge base construction grounded in inferentialist semantics, where knowledge engineering is re-conceived as explicitation rather than extraction from expert testimony or textual content. A human expert develops a bilateral position (commitments and denials) about a topic through prover-skeptic dialogue with a large language model (LLM) opponent. The LLM proposes tensions (claims that parts of the position are jointly incoherent) which the expert resolves by retraction, refinement, or contestation. The LLM thus serves as a defeasible derivability oracle whose unreliability is structurally contained by the expert's authority. Our main technical contribution is a mapping from Elenchus dialectical states to material bases in Hlobil and Brandom's NonMonotonic MultiSuccedent (NMMS) logic, satisfying Containment and enabling the elaboration of logical vocabulary that makes explicit the inferential relationships negotiated in the dialectic. We demonstrate the approach on the W3C PROV-O provenance ontology, where a single dialogue session elicits and structures design tensions that a domain expert can articulate, corresponding to decisions documented in a retrospective analysis of the ontology's design. Using pyNMMS, an automated NMMS reasoner, we verify that the structural properties of the resulting material base (nontransitivity, nonmonotonicity, and independence) correspond to specific PROV design rationales, demonstrating end-to-end integration from dialogue through formal reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。