arXiv:2508.03500cs.AI2025-08AAAI被引 2

让大模型自动发现并修正数学推理中的错误,提升准确性与可解释性。

Error Detection and Correction for Interpretable Mathematics in Large Language Models

  • 用大模型生成方程组,再通过符号化框架检测错误并反馈修正。
  • 在多个数据集上降低计算与成本开销,准确率反而提升。
  • 适合需要高精度数学表达或代码生成的场景,如教育、科研工具。

近期的大语言模型(LLMs)已具备多步推理能力,如链式思维提示。然而,其中间步骤常含错误,可能导致最终预测不准确。此外,模型仍存在幻觉问题,难以遵守指定输出格式,尤其在生成数学表达式或源代码时尤为严重。本文提出EDCIM(Error Detection and Correction for Interpretable Mathematics),一种针对可解释数学任务的错误检测与纠正方法。该任务要求模型生成明确求解问题的功能形式(以自然语言表达),而非黑箱答案。EDCIM首先使用大模型生成问题对应的方程组,随后通过符号化错误检测框架识别错误并提供针对性反馈以实现大模型修正。为优化效率,EDCIM融合轻量级开源模型与更强大的专有模型,通过单一超参数控制成本与准确性的权衡,用户可根据需求灵活配置。实验结果表明,当配置合理时,EDCIM显著降低计算与财务成本,同时保持甚至提升预测准确率。

原文摘要 · Abstract (English)

Recent large language models (LLMs) have demonstrated the ability to perform explicit multi-step reasoning such as chain-of-thought prompting. However, their intermediate steps often contain errors that can propagate leading to inaccurate final predictions. Additionally, LLMs still struggle with hallucinations and often fail to adhere to prescribed output formats, which is particularly problematic for tasks like generating mathematical expressions or source code. This work introduces EDCIM (Error Detection and Correction for Interpretable Mathematics), a method for detecting and correcting these errors in interpretable mathematics tasks, where the model must generate the exact functional form that explicitly solve the problem (expressed in natural language) rather than a black-box solution. EDCIM uses LLMs to generate a system of equations for a given problem, followed by a symbolic error-detection framework that identifies errors and provides targeted feedback for LLM-based correction. To optimize efficiency, EDCIM integrates lightweight, open-source LLMs with more powerful proprietary models, balancing cost and accuracy. This balance is controlled by a single hyperparameter, allowing users to control the trade-off based on their cost and accuracy requirements. Experimental results across different datasets show that EDCIM significantly reduces both computational and financial costs, while maintaining, and even improving, prediction accuracy when the balance is properly configured.

大模型数学推理错误修正可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。