用合成数据提升小模型算术推理能力,效果显著且适合本地部署。
Structured Synthetic Reasoning Data for Arithmetic Fine-Tuning of Small Language Models
- 设计结构化合成数据,融合解题过程与苏格拉底式引导。
- 小模型在GSM8K上准确率提升至49.1%~66.5%,跨任务泛化能力强。
- 适合资源有限场景下优化小型语言模型的逻辑推理能力。
小规模语言模型适合本地部署,但常在多步算术推理上表现不佳。本文研究在消费级硬件限制下,结构化合成推理数据能否改善这一问题。基于GSM8K,使用GPT-5-mini生成包含21,250个样本的算术应用题变体语料库,结合自然语言解题路径、轻量苏格拉底式提示、结构变化和无关干扰信息。随后在消费者级硬件(Apple M4,16 GB RAM)上,对Qwen3-0.6B和Qwen3-1.7B模型使用LoRA进行微调。在GSM8K上的精确匹配准确率分别从36.5%提升至49.1%,以及从53.5%提升至66.5%。对于Qwen3-1.7B,迁移至相关算术基准表现更优,达到MultiArith的98.9%和SVAMP的73.0%,而基线模型分别为54.4%和45.3%。定性分析显示,微调后模型推理路径更短,算术错误和误用干扰信息更少,且更稳定受益于自一致性采样。结果表明,低成本的合成数据设计能显著提升小模型的算术适应能力。由于干预结合了苏格拉底式提示与其他数据设计,结果支持结构化合成推理数据的有效性,而非仅验证苏格拉底引导的因果作用。
原文摘要 · Abstract (English)
Small language models are attractive for local deployment, but they often struggle with multi-step arithmetic reasoning. We study whether structured synthetic reasoning data can improve this behaviour under consumer-hardware constraints. Starting from GSM8K, we generated a 21,250-example corpus of grade-school arithmetic word-problem variants using GPT-5-mini, combining natural-language solution traces, light Socratic-style cues, structural variation, and irrelevant distractor context. We then fine-tuned Qwen3-0.6B and Qwen3-1.7B with LoRA on consumer hardware (Apple M4, 16 GB RAM). Exact-match accuracy on GSM8K improved from 36.5% to 49.1% for Qwen3-0.6B and from 53.5% to 66.5% for Qwen3-1.7B. For Qwen3-1.7B, transfer to related arithmetic benchmarks was stronger, reaching 98.9% on MultiArith and 73.0% on SVAMP, compared with 54.4% and 45.3% for the base model. Qualitative analysis suggests that fine-tuned models produce shorter reasoning traces, make fewer arithmetic and distractor-use errors, and benefit more consistently from self-consistency sampling. These results show that low-cost synthetic data design can materially improve arithmetic adaptation in small language models. Because the intervention combines Socratic-style cues with other data-design choices, we interpret the gains as evidence for structured synthetic reasoning data rather than as a causal test of Socratic guidance alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。