用智能体生成高质量数学题,小数据也能让大模型变强。
AgenticMath: Enhancing LLM Reasoning via Agentic-based Math Data Generation
- 四阶段智能体流程:筛选、重述、推理增强、质量评估
- 3万到6万条数据就超越百万级低质数据训练效果
- 适合想提升数学推理能力的模型开发者
高质量数据集对提升大语言模型(LLM)推理能力至关重要,但现有方法常产生错误答案且信息贫乏。为此,我们提出AgenticMath,一种基于智能体的数学问答对生成方法。该方法包含四个阶段:(1) 种子问题筛选,选择信息丰富、复杂且清晰的问题;(2) 智能体重述,通过多智能体系统生成多样且逻辑一致的改写版本;(3) 答案增强,利用链式思维推理重构答案,无需人工标注;(4) 问答对评估,仅保留最优对。实验表明,在仅3万至6万条样本的AgenticMath数据上微调3B-8B参数模型,其在多种域内与域外数学推理基准测试中表现优于或媲美使用40万甚至230万样本训练的基线模型。结果证明,有针对性的高质量数据生成比大规模低质数据更高效。
原文摘要 · Abstract (English)
The creation of high-quality datasets to improve Large Language Model (LLM) reasoning remains a significant challenge, as current methods often suffer from generating low-quality/incorrect answers and limited information richness from available data sources. To address this, we propose AgenticMath, a novel agentic method for generating high-quality mathematical question-answer pairs to enhance the supervised fine-tuning of LLMs. Our method operates through four stages: (1) Seed Question Filter that selects questions with high information richness, complexity, and clarity; (2) an Agentic Question Rephrase step that employs a multi-agent system to generate diverse, logically consistent paraphrases; (3) an Answer Augment step where rewrite answers using chain-of-thought reasoning to enhance numerical and logical correctness, without reliance on human-provided labels; and (4) a final Question and Answer Evaluation that retains only the most superior pairs. Extensive experiments demonstrate that, fine-tuning 3B-8B parameter LLMs on AgenticMath generated datasets (comprising only 30-60K math samples) achieves competitive or superior performance on diverse in domain and out-of-domain mathematical reasoning benchmarks compared to baselines trained on much more data (e.g., 400K or 2.3M samples). Our work demonstrates that targeted, high-quality data generation is a more efficient path to improving mathematical reasoning in LLMs than large-scale, low-quality alternatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。