测试大模型对推理过程的逻辑和完整性判断能力,发现其易高估推理质量。
C2-Faith: Benchmarking LLM Judges for Causal and Coverage Faithfulness in Chain-of-Thought Reasoning
- 分解忠实性为因果与覆盖两个维度,构建可控扰动数据集
- 模型能发现错误但难定位,且普遍高估推理完整性
- 揭示大模型作为推理裁判的可靠性局限,适合研究评估方法者
大型语言模型(LLMs)被越来越多地用作链式思维(CoT)推理的评判者,但其是否能可靠评估推理过程的忠实性而非仅判断答案合理性仍不明确。我们提出C2-Faith,基于PRM800K构建的基准,将忠实性明确拆分为两个互补维度:因果性(每一步是否逻辑上源自前文)与覆盖性(是否包含关键中间推断)。通过控制扰动,我们构造出已知因果错误位置的样本(替换单步为逻辑不一致项),以及在不同删减率下的覆盖性缺失样本,实现与参考标签的直接对比。我们在三个任务中评估了三类前沿LLM裁判:二元因果检测、因果步骤定位与覆盖评分。结果表明,裁判可靠性高度依赖任务,无单一模型在所有场景占优。尽管模型常能检测到错误,却难以准确定位,暴露出检测与归因间的巨大差距。此外,所有裁判系统性高估推理完整性,即使大量中间推理缺失仍给出高覆盖评分。这些发现揭示了LLM裁判在过程评估中的根本局限,强调使用其评估推理质量时需更可靠、更校准的方法。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly used as judges of chain-of-thought (CoT) reasoning, yet it remains unclear whether they can reliably assess process faithfulness rather than merely answer plausibility. We introduce C2-Faith, a benchmark built from PRM800K that explicitly decomposes faithfulness into two complementary dimensions: causality (whether each step logically follows from prior context) and coverage (whether essential intermediate inferences are present). Using controlled perturbations, we construct examples with known causal error positions by replacing a single step with a logically inconsistent variant, and with controlled coverage deletions at varying rates, enabling direct measurement against reference labels. We evaluate three frontier LLM judges across three tasks: binary causal detection, causal step localization, and coverage scoring. Our results reveal that judge reliability is highly task-dependent, with no single model dominating across settings. While models often detect that an error exists, they struggle to accurately localize it, indicating a substantial gap between detection and attribution. Moreover, all judges systematically overestimate reasoning completeness, assigning high coverage scores even when substantial portions of intermediate reasoning are missing. These findings expose fundamental limitations of LLM judges in process-level evaluation and highlight the need for more reliable and calibrated methods when using LLMs to assess reasoning quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。