arXiv:2607.07229cs.AI2026-07

检测AI推理过程是否自洽,提升安全评估可信度

Reasoning Consistency Scanning: A Framework for Auditing Chain-of-Thought Validity in AI Safety Evaluations

论文配图:Reasoning Consistency Scanning: A Framework for Auditing Chain-of-Thought Validity in AI Safety Evaluations
图 1 · 摘自论文原文
  • 通过逻辑一致性分析替代难测的推理真实性
  • 在60份评估样本中发现不一致现象普遍存在
  • 可直接用于事后评估,适合安全审查人员使用

以往研究显示,链式思维(CoT)推理常不忠实:模型声称的推理过程与其输出生成过程不一致。但验证这种不忠实需控制实验干预,无法在事后评估中应用。本文转向更可行的问题:所陈述的推理是否与伴随的答案逻辑自洽?该问题可仅凭评估记录判断。我们提出「推理一致性扫描」框架,用于检测安全评估中的逻辑一致性。贡献包括:第一,将一致性与忠实性区分,并建立六类不一致的分类体系;第二,构建包含60个样本的验证基准,样本源自InstrumentalEval输出并人工调整;第三,实现首个针对安全评估记录的扫描工具InspectScout;第四,在四个生成模型和三个inspect_eval任务上验证,结果表明推理不一致现象存在、可检测且随模型和任务类型系统性变化。

原文摘要 · Abstract (English)

Prior work has shown that chain-of-thought (CoT) reasoning is often unfaithful: a model's stated reasoning does not reliably reflect the process that produced its output. Detecting unfaithfulness, though, requires controlled experimental interventions, which cannot be applied to evaluation transcripts after the fact. We turn instead to a more tractable question that has received less attention: whether the stated reasoning is logically consistent with the answer it accompanies. Unlike faithfulness, consistency can be assessed from a transcript alone, with no intervention. We introduce reasoning consistency scanning, a reusable method for detecting this property in AI safety evaluation transcripts. Our contributions are fourfold. First, we formalize reasoning consistency as distinct from faithfulness and define a six-subtype taxonomy of inconsistency. Second, we build a validated benchmark of 60 transcripts, manually adapted from InstrumentalEval outputs. Third, we implement a working scanner for InspectScout, the first to target this property in safety evaluation transcripts. Fourth, we report results across four generator models and three evaluations from inspect_evals, showing that reasoning inconsistency is present, detectable, and varies systematically across both models and task types.

AI安全推理一致性评估框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。