arXiv:2604.22271cs.LG2026-04被引 4

大模型靠内部信心信号自检纠错,而非仅依赖生成概率。

How LLMs Detect and Correct Their Own Errors: The Role of Internal Confidence Signals

论文配图:How LLMs Detect and Correct Their Own Errors: The Role of Internal Confidence Signals
图 1 · 摘自论文原文
  • 用第二阶信心模型解释模型如何自我评估。
  • 答案后信心信号能提前预判错误并决定是否修正。
  • 跨模型和任务验证,适合研究模型可解释性的人看

大型语言模型能在无外部反馈下检测并修正自身错误,但其内在机制尚不明确。本文从决策神经科学中的二阶信心模型出发,研究发现模型在回答后立即(即答案后换行符处,PANL)会缓存一个独立于概率的评价信号,该信号与口头信心相关且可分离。通过验证-修正范式,我们发现:(i) 口头信心显著优于词元概率预测错误检测,排除一阶模型解释;(ii) PANL激活值在口头信心之外仍可预测错误检测;(iii) PANL能预测哪些错误可被修正,而所有行为信号均无法做到。因果干预证实,当答案信息受损时,恢复PANL信号可挽救错误检测能力。上述结果在Gemma 3 27B与Qwen 2.5 7B模型,以及TriviaQA和MNLI任务中均复现。这表明大模型天然具备二阶信心架构,其内部评价信号不仅能判断答案是否错误,还能判断是否有能力修复。

原文摘要 · Abstract (English)

Large language models can detect their own errors and sometimes correct them without external feedback, but the underlying mechanisms remain unknown. We investigate this through the lens of second-order models of confidence from decision neuroscience. In a first-order system, confidence derives from the generation signal itself and is therefore maximal for the chosen response, precluding error detection. Second-order models posit a partially independent evaluative signal that can disagree with the committed response, providing the basis for error detection. Kumaran et al. (2026) showed that LLMs cache a confidence representation at a token immediately following the answer (i.e. post-answer newline: PANL) -- that causally drives verbal confidence and dissociates from log-probabilities. Here we test whether this PANL signal extends beyond confidence to support error detection and self-correction. Here we test whether this signal supports error detection and self-correction, deriving predictions from the second-order framework. Using a verify-then-correct paradigm, we show that: (i) verbal confidence predicts error detection far beyond token log-probabilities, ruling out a first-order account; (ii) PANL activations predict error detection beyond verbal confidence itself; and (iii) PANL predicts which errors the model can correct -- where all behavioural signals fail. Causal interventions confirm that PANL signals rescue error detection behavior when answer information is corrupted. All findings replicate across models (Gemma 3 27B and Qwen 2.5 7B) and tasks (TriviaQA and MNLI). These results reveal that LLMs naturally implement a second-order confidence architecture whose internal evaluative signal encodes not only whether an answer is likely wrong but whether the model has the knowledge to fix it.

模型自检信心信号可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。