用混合驱动架构自动构建可验证的知识图谱,解决生成结果不可靠的问题。
HyDRA: A Hybrid-Driven Reasoning Architecture for Verifiable Knowledge Graphs
- 通过神经符号代理协作定义领域问题,指导知识图谱构建
- 利用可验证契约控制大模型生成,确保输出结构正确
- 提出基于符号验证的新评估框架,适合可信AI研究者
符号知识(如知识图谱)与神经网络生成能力的结合是推动神经符号AI发展的关键。当前自动化知识图谱构建的主要瓶颈在于输出的可靠性、一致性和可验证性问题,常导致图谱中出现孤立数据节点或抽象类与具体实例混淆等结构性错误。为此,本文提出HyDRA——一种面向可验证知识图谱自动化的混合驱动推理架构。给定领域或初始文档集,HyDRA首先通过一组协同工作的神经符号代理构建本体,并共同确定一组能力问题(CQs),明确本体需回答的范围与要求。基于这些CQs,构建本体图谱以引导从任意文档中自动提取三元组生成知识图谱。受设计契约(DbC)启发,方法采用可验证契约作为主要控制机制,调控大语言模型(LLMs)的生成过程。为验证结果,我们超越传统基准,提出一种评估框架,借助神经符号AI框架SymbolicAI中的符号验证方法,评估生成知识图谱的功能正确性。本工作贡献了一种提升自动化知识图谱可靠性与功能完整性评估方法的混合驱动架构,代码已公开。
原文摘要 · Abstract (English)
The synergy between symbolic knowledge, often represented by Knowledge Graphs (KGs), and the generative capabilities of neural networks is central to advancing neurosymbolic AI. A primary bottleneck in realizing this potential is the difficulty of automating KG construction, which faces challenges related to output reliability, consistency, and verifiability. These issues can manifest as structural inconsistencies within the generated graphs, such as the formation of disconnected $\textit{isolated islands}$ of data or the inaccurate conflation of abstract classes with specific instances. To address these challenges, we propose HyDRA, a $\textbf{Hy}$brid-$\textbf{D}$riven $\textbf{R}$easoning $\textbf{A}$rchitecture designed for verifiable KG automation. Given a domain or an initial set of documents, HyDRA first constructs an ontology via a panel of collaborative neurosymbolic agents. These agents collaboratively agree on a set of competency questions (CQs) that define the scope and requirements the ontology must be able to answer. Given these CQs, we build an ontology graph that subsequently guides the automated extraction of triplets for KG generation from arbitrary documents. Inspired by design-by-contracts (DbC) principles, our method leverages verifiable contracts as the primary control mechanism to steer the generative process of Large Language Models (LLMs). To verify the output of our approach, we extend beyond standard benchmarks and propose an evaluation framework that assesses the functional correctness of the resulting KG by leveraging symbolic verifications as described by the neurosymbolic AI framework, $\textit{SymbolicAI}$. This work contributes a hybrid-driven architecture for improving the reliability of automated KG construction and the exploration of evaluation methods for measuring the functional integrity of its output. The code is publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。