用估算验证+方程求解,提升大模型数学应用题准确率
Solving Math Word Problems Using Estimation Verification and Equation Generation
- 先分解题目生成方程,再用符号求解器得答案
- 通过二次估算验证结果,错误则迭代修正
- 在代数与三角应用题上均达领先效果
大型语言模型在各类任务中表现优异,但在数学应用题(MWP)上仍面临挑战,因其需复杂推理与数学能力。本文提出新方法:首先引导模型从问题分解中生成方程,再由外部符号求解器计算答案;为确保准确性,再次让模型进行估算,并与原结果比对验证。若不一致,则启动迭代修正流程直至正确。该方法在已有代数与数值类MWP数据集上取得新最优性能,平均提升近2个百分点;首次在三角函数类题目上实现良好效果。研究还构建了两个新数据集:SVAMPClean与Trig300,以推动大模型推理能力测试。
原文摘要 · Abstract (English)
Large Language Models (LLMs) excel at various tasks, including problem-solving and question-answering. However, LLMs often find Math Word Problems (MWPs) challenging because solving them requires a range of reasoning and mathematical abilities with which LLMs seem to struggle. Recent efforts have helped LLMs solve more complex MWPs with improved prompts. This study proposes a novel method that initially prompts an LLM to create equations from a decomposition of the question, followed by using an external symbolic equation solver to produce an answer. To ensure the accuracy of the obtained answer, inspired by an established recommendation of math teachers, the LLM is instructed to solve the MWP a second time, but this time with the objective of estimating the correct answer instead of solving it exactly. The estimation is then compared to the generated answer to verify. If verification fails, an iterative rectification process is employed to ensure the correct answer is eventually found. This approach achieves new state-of-the-art results on datasets used by prior published research on numeric and algebraic MWPs, improving the previous best results by nearly two percent on average. In addition, the approach obtains satisfactory results on trigonometric MWPs, a task not previously attempted to the authors' best knowledge. This study also introduces two new datasets, SVAMPClean and Trig300, to further advance the testing of LLMs' reasoning abilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。