用结构化知识图谱强制校验,让语言模型只说真话。
Stemming Hallucination in Language Models Using a Licensing Oracle
- 在生成过程嵌入确定性验证,确保输出符合知识图谱事实。
- 零虚假回答,91.8%的事实回应准确率,完美避免幻觉。
- 适合需要高可信度的医疗、法律等专业领域应用。
语言模型虽能生成语法正确的内容,但常产生事实错误的幻觉。本文提出Licensing Oracle架构,通过与结构化知识图谱进行形式化验证,强制模型只生成真实信息。不同于依赖数据量或微调的统计方法,该方案将确定性验证步骤直接嵌入生成流程,确保输出的准确性。实验对比显示,尽管检索增强生成(RAG)和微调可提升表现,仍无法根除幻觉。而Licensing Oracle实现了100%的拒绝精度(AP=1.0)和0%的错误回答率(FAR-NE=0.0),在事实性回答中达到89.1%的准确率。结果表明,此类架构创新为具有结构化知识的领域提供了必要且充分的幻觉抑制方案,其保障能力远超现有统计方法。尽管聚焦于事实型任务,该框架也为未来可信、基于认知的AI系统提供了新路径。
原文摘要 · Abstract (English)
Language models exhibit remarkable natural language generation capabilities but remain prone to hallucinations, generating factually incorrect information despite producing syntactically coherent responses. This study introduces the Licensing Oracle, an architectural solution designed to stem hallucinations in LMs by enforcing truth constraints through formal validation against structured knowledge graphs. Unlike statistical approaches that rely on data scaling or fine-tuning, the Licensing Oracle embeds a deterministic validation step into the model's generative process, ensuring that only factually accurate claims are made. We evaluated the effectiveness of the Licensing Oracle through experiments comparing it with several state-of-the-art methods, including baseline language model generation, fine-tuning for factual recall, fine-tuning for abstention behavior, and retrieval-augmented generation (RAG). Our results demonstrate that although RAG and fine-tuning improve performance, they fail to eliminate hallucinations. In contrast, the Licensing Oracle achieved perfect abstention precision (AP = 1.0) and zero false answers (FAR-NE = 0.0), ensuring that only valid claims were generated with 89.1% accuracy in factual responses. This work shows that architectural innovations, such as the Licensing Oracle, offer a necessary and sufficient solution for hallucinations in domains with structured knowledge representations, offering guarantees that statistical methods cannot match. Although the Licensing Oracle is specifically designed to address hallucinations in fact-based domains, its framework lays the groundwork for truth-constrained generation in future AI systems, providing a new path toward reliable, epistemically grounded models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。