arXiv:2609.05025cs.CLcs.AI2026-09

用SQL能力实现无需标注的幻觉检测,让大模型自建数据库验证输出真伪。

Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection

论文配图:Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection
图 1 · 摘自论文原文
  • 让大模型从文本构建SQL数据库,用结构化数据做推理检查
  • 在RAGTruth和DiaHalu数据集上效果优于直接预测,接近顶尖方法
  • 无需领域微调,利用模型已有的低级符号能力,适合追求可解释性的人

幻觉——语言模型生成与事实不符或无依据的内容——是提示和微调语言模型面临的主要挑战。由于大模型推理过程不透明,难以理解输出为何错误。本文探索大模型能否利用低层级、符号化的技能(如SQL)实现高阶任务中的无监督幻觉检测。具体做法是:让大模型从参考文档构建SQL数据库,并基于该数据库对参考内容与生成回复进行推理,形成神经符号化的验证流程。在RAGTruth和DiaHalu幻觉检测数据集上,该方法优于直接预测,性能接近当前最优检测方法,且无需领域特定微调,仅依赖大模型本身已具备的通用低级符号能力。这表明应进一步研究低级符号能力在神经符号框架中的作用。

原文摘要 · Abstract (English)

Hallucination-where a language model generates outputs that are factually incorrect or unsupported by the source-is a major challenge for both prompted and fine-tuned language models. Detecting hallucinations is difficult due to the opaque reasoning processes of LLMs, which often provide little insight into why a model's output may be inaccurate. In this work, we investigate whether an LLM can use an alternative, low level, symbolic competence such as SQL for unsupervised hallucination detection in some high level task. For this, we make an LLM build an SQL database from reference documents. This SQL database is then used for reasoning over the reference and the sampled response in a hallucination detection pipeline that is grounded in the database, thereby providing a neurosymbolic checkup. On RAGTruth and DiaHalu hallucination detection datasets, we find that our approach improves on direct prediction and competes with state-of-the-art hallucination detection methods, while not requiring domain-specific fine-tuning. Instead it relies on a low-level general competence already present in LLMs. This warrants further investigation of low-level LLM competences in neurosymbolic approaches.

幻觉检测神经符号SQL无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。