通过分析推理步骤的概率分布,量化大模型的推理质量。
EvalQReason: A Framework for Step-Level Reasoning Evaluation in Large Language Models
- 基于相邻步骤概率分布差异评估局部连贯性。
- 7B模型在数学数据上准确率达F1=0.88,ROC-AUC=0.97。
- 揭示数学与医疗推理模式本质差异,适合可信AI评估。
大型语言模型(LLMs)在需可靠推理的关键应用中日益普及,但其内部推理过程难以系统评估。现有方法仅关注最终答案正确性,难以揭示推理中间步骤的演化过程。我们提出EvalQReason框架,通过无需人工标注的步骤级概率分布分析,量化推理质量。该框架引入两个互补算法:连续步骤发散(CSD),衡量相邻步骤间的局部连贯性;步骤到最终结果收敛(SFC),评估全局与最终答案的一致性。每个算法使用五种统计指标捕捉推理动态。在数学与医学数据集上对开源7B参数模型的实验表明,基于CSD的特征在正确性分类中表现优异,经典机器学习模型达到F1=0.78,ROC-AUC=0.82;序列神经模型显著提升性能(F1=0.88,ROC-AUC=0.97)。CSD始终优于SFC,序列架构优于传统模型。关键发现:数学推理呈现明显的发散性区分模式,而医学推理则缺乏显著判别信号,揭示了不同领域推理机制的根本差异。EvalQReason实现可扩展、过程感知的推理可靠性评估,确立概率发散分析为可信AI部署的原理性方法。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly deployed in critical applications requiring reliable reasoning, yet their internal reasoning processes remain difficult to evaluate systematically. Existing methods focus on final-answer correctness, providing limited insight into how reasoning unfolds across intermediate steps. We present EvalQReason, a framework that quantifies LLM reasoning quality through step-level probability distribution analysis without requiring human annotation. The framework introduces two complementary algorithms: Consecutive Step Divergence (CSD), which measures local coherence between adjacent reasoning steps, and Step-to-Final Convergence (SFC), which assesses global alignment with final answers. Each algorithm employs five statistical metrics to capture reasoning dynamics. Experiments across mathematical and medical datasets with open-source 7B-parameter models demonstrate that CSD-based features achieve strong predictive performance for correctness classification, with classical machine learning models reaching F1=0.78 and ROC-AUC=0.82, and sequential neural models substantially improving performance (F1=0.88, ROC-AUC=0.97). CSD consistently outperforms SFC, and sequential architectures outperform classical machine learning approaches. Critically, reasoning dynamics prove domain-specific: mathematical reasoning exhibits clear divergence-based discrimination patterns between correct and incorrect solutions, while medical reasoning shows minimal discriminative signals, revealing fundamental differences in how LLMs process different reasoning types. EvalQReason enables scalable, process-aware evaluation of reasoning reliability, establishing probability-based divergence analysis as a principled approach for trustworthy AI deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。