用认知分级提示法提升大模型数学解题能力与可解释性
BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Prompts
- 按布卢姆认知层次设计分步提示,引导模型从记忆到评价逐步推理
- 在5个数学推理数据集上显著提升准确率,收敛条件下提前终止生成
- 适合需要透明推理过程的教育类AI应用,如智能辅导系统
尽管大型语言模型在多项任务中表现优异,数学推理仍是其主要挑战。受人类学习时更关注‘如何思考’而非‘思考什么’的启发,我们提出BloomWise,一种基于布卢姆认知分类学的提示技术,旨在提升大模型在数学问题求解中的表现,并增强其解答的可解释性。该方法通过一系列认知层级(从记忆到评价)引导模型生成解释性解题过程,若连续两个层级得出相同答案,则提前输出最早该层级的结果;否则持续至所有层级完成。在五个主流数学推理数据集上的广泛实验表明,BloomWise有效提升了性能,并通过详尽的消融研究验证了各组件贡献。
原文摘要 · Abstract (English)
Despite the remarkable capabilities of large language models (LLMs) across a range of tasks, mathematical reasoning remains a challenging frontier. Motivated by the observation that humans learn more effectively when prompted not what to think but how to think, we introduce BloomWise, a cognitively-inspired prompting technique designed to enhance LLMs' performance on mathematical problem solving while making their solutions more explainable. BloomWise encourages LLMs to generate solutions - in the form of explanations - by progressing through a sequence of cognitive operations-from basic (e.g., remembering) to more advanced reasoning skills (e.g., evaluating) - mirroring how humans build understanding. The process iterates through these levels, halting early if a convergence criterion is met: specifically, if two or more consecutive levels yield the same answer, the solution from the earliest such level is output; otherwise, the process continues until all levels are completed. Through extensive experiments across five popular math reasoning datasets, we demonstrate the effectiveness of BloomWise. We also present comprehensive ablation studies to analyze the strengths of each component within our system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。