arXiv:2510.11529cs.CL2025-10被引 1

通过内部状态与推理一致性联合检测大模型幻觉。

Hallucination Detection via Internal States and Structured Reasoning Consistency in Large Language Models

  • 设计多路径推理获取细粒度信号,融合内部状态与推理链
  • 在三个基准上优于强基线,显著提升幻觉检测效果
  • 适合需要高可信生成的场景,如医疗、法律问答

大语言模型的复杂幻觉检测面临「检测困境」:探测内部状态的方法擅长发现事实矛盾,但对逻辑谬误无能为力;而外部推理链验证则相反。前者在开放域问答等依赖事实的任务中失效,后者在数学推理等逻辑密集任务中表现不佳。本文提出统一框架,克服两大障碍:信号稀疏性(粗粒度推理链缺乏可比信号)与表征错位(内部状态与推理空间语义不匹配)。引入多路径推理机制生成更细粒度信号,采用分段感知的时间化交叉注意力模块实现自适应融合,精准定位细微不一致。在三个不同基准和两个主流LLM上的实验表明,该框架持续显著优于强基线。代码已开源:https://github.com/peach918/HalluDet。

原文摘要 · Abstract (English)

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical fallacies, while those verifying externalized reasoning (Chain-of-Thought Verification) show the opposite behavior. This schism creates a task-dependent blind spot: Chain-of-Thought Verification fails on fact-intensive tasks like open-domain QA where reasoning is ungrounded, while Internal State Probing is ineffective on logic-intensive tasks like mathematical reasoning where models are confidently wrong. We resolve this with a unified framework that bridges this critical gap. However, unification is hindered by two fundamental challenges: the Signal Scarcity Barrier, as coarse symbolic reasoning chains lack signals directly comparable to fine-grained internal states, and the Representational Alignment Barrier, a deep-seated mismatch between their underlying semantic spaces. To overcome these, we introduce a multi-path reasoning mechanism to obtain more comparable, fine-grained signals, and a segment-aware temporalized cross-attention module to adaptively fuse these now-aligned representations, pinpointing subtle dissonances. Extensive experiments on three diverse benchmarks and two leading LLMs demonstrate that our framework consistently and significantly outperforms strong baselines. Our code is available: https://github.com/peach918/HalluDet.

幻觉检测推理一致性大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。