让大模型根据自身能力自动选择解题策略,提升数学推理效率与准确率。
Teaching LLMs According to Their Aptitude: Adaptive Reasoning for Mathematical Problem Solving
- 训练时根据模型能力筛选数据,实现个性化学习
- 在6个基准上表现优于或媲美纯工具推理方法
- 适合需要高效精准数学推理的场景,如教育AI
现有大语言模型(LLMs)的数学推理方法主要依赖思维链(CoT)以保证泛化性,或工具集成推理(TIR)以确保计算精度。尽管已有尝试融合两者,但多采用事后筛选或预设策略,未解决模型能否自主依据自身能力调整推理方式的问题。本文提出TATA(Teaching LLMs According to Their Aptitude),一种自适应框架,使LLM能基于内在能力自发选择合适推理路径。TATA在监督微调阶段引入对基础模型能力敏感的数据选择机制,使模型在测试时可自主判断并应用最优策略。我们在六个数学推理基准上,使用通用与数学专项模型进行大量实验,结果表明TATA有效结合了CoT与TIR的优势,在性能上达到或超越仅使用TIR的方法,并显著提升推理效率。进一步分析证实,能力感知的数据选择是实现有效自适应推理的关键,能使推理策略与模型能力精准对齐。
原文摘要 · Abstract (English)
Existing approaches to mathematical reasoning with large language models (LLMs) rely on Chain-of-Thought (CoT) for generalizability or Tool-Integrated Reasoning (TIR) for precise computation. While efforts have been made to combine these methods, they primarily rely on post-selection or predefined strategies, leaving an open question: whether LLMs can autonomously adapt their reasoning strategy based on their inherent capabilities. In this work, we propose TATA (Teaching LLMs According to Their Aptitude), an adaptive framework that enables LLMs to personalize their reasoning strategy spontaneously, aligning it with their intrinsic aptitude. TATA incorporates base-LLM-aware data selection during supervised fine-tuning (SFT) to tailor training data to the model's unique abilities. This approach equips LLMs to autonomously determine and apply the appropriate reasoning strategy at test time. We evaluate TATA through extensive experiments on six mathematical reasoning benchmarks, using both general-purpose and math-specialized LLMs. Empirical results demonstrate that TATA effectively combines the complementary strengths of CoT and TIR, achieving superior or comparable performance with improved inference efficiency compared to TIR alone. Further analysis underscores the critical role of aptitude-aware data selection in enabling LLMs to make effective and adaptive reasoning decisions and align reasoning strategies with model capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。