通过分析推理与答案一致性,精准检测大模型幻觉
Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Models
- 提取关键推理步骤,综合四类诊断信号判断异常
- 在多个数据集上显著优于现有检测方法
- 适合评估需要可解释推理的大模型系统
大型推理模型(LRMs)通过显式的多步推理轨迹提升复杂任务的透明度与性能,但这些推理过程可能冗余或逻辑不一致,成为难以察觉的新幻觉来源。现有幻觉检测方法主要关注答案层面的不确定性,常忽略推理轨迹引发的幻觉或逻辑错误。为此,我们提出RACE(推理与答案一致性评估)框架,专门用于LRMs的幻觉检测。RACE通过提取核心推理步骤,计算四类诊断信号:跨样本推理一致性、基于熵的答案不确定性、推理与答案间的语义对齐度,以及推理内部连贯性。联合利用这些信号,使RACE能更稳健地识别LRMs中的幻觉。在多个数据集和不同LLM上的实验表明,RACE性能优于现有基线,提供了一种鲁棒且通用的LRM评估方案。源码已开源于https://github.com/bebr2/RACE。
原文摘要 · Abstract (English)
Large Reasoning Models (LRMs) extend large language models with explicit, multi-step reasoning traces to enhance transparency and performance on complex tasks. However, these reasoning traces can be redundant or logically inconsistent, becoming a new and hard-to-detect source of hallucination. Existing hallucination detection methods focus primarily on answer-level uncertainty and often fail to detect hallucinations or logical inconsistencies arising from the model's reasoning trace. This oversight is particularly problematic for LRMs, where the explicit thinking trace is not only an important support to the model's decision-making process but also a key source of potential hallucination. To this end, we propose RACE (Reasoning and Answer Consistency Evaluation), a novel framework specifically tailored for hallucination detection in LRMs. RACE operates by extracting essential reasoning steps and computing four diagnostic signals: inter-sample consistency of reasoning traces, entropy-based answer uncertainty, semantic alignment between reasoning and answers, and internal coherence of reasoning. The joint utilization of these signals makes RACE a more robust detector of hallucinations in LRMs. Experiments across datasets and different LLMs demonstrate that RACE outperforms existing hallucination detection baselines, offering a robust and generalizable solution for evaluating LRMs. The source code is available at https://github.com/bebr2/RACE
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。