用领域语言自动生成可验证的数学逻辑题,提升大模型推理能力
PuzzleClone: A DSL-Powered Framework for Synthesizing Verifiable Data
- 用结构化逻辑规范定义题目种子,通过随机化变量和约束生成多样题型
- 构建8.3万道可程序验证的题目,训练后模型在多个基准上提升超18个百分点
- 适合需要高质量推理数据的研究者,尤其关注数学逻辑任务的开发者
高质量、可验证答案的数学与逻辑数据集对增强大语言模型的推理能力至关重要。尽管现有数据增强技术已推动大规模基准建设,但大多数由LLM生成的数据集仍存在可靠性差、多样性不足和可扩展性弱的问题。为此,我们提出PuzzleClone,一个基于新型领域专用语言(DSL)的可扩展可验证数据合成框架。该方法包含三项创新:(1) 将初始题目编码为结构化逻辑规范,(2) 通过系统化的变量与约束随机化生成可扩展变体,(3) 利用复现机制确保生成题目的有效性。基于此,我们构建了包含超过83,000道多样化且程序化验证的题目基准PC-83K。这些题目涵盖广泛难度与形式,对当前先进模型构成显著挑战。实验表明,在PC-83K上进行后训练(SFT与强化学习)后,模型在测试集及多个逻辑与数学基准上的表现均显著提升:平均得分从14.5提升至66.0,7个基准中最高提升达18.4个百分点(SATBench从51.6升至70.0)。代码与数据已在https://github.com/HiThink-Research/PuzzleClone公开。
原文摘要 · Abstract (English)
High-quality mathematical and logical datasets with verifiable answers are essential for strengthening the reasoning capabilities of large language models (LLMs). While recent data augmentation techniques have facilitated the creation of large-scale benchmarks, existing LLM-generated datasets often suffer from limited reliability, diversity, and scalability. To address these challenges, we introduce PuzzleClone, a formal framework for synthesizing verifiable data at scale using a novel DSL-driven approach. Our approach features three key innovations: (1) encoding seed puzzles into structured logical specifications, (2) generating scalable variants through systematic variable and constraint randomization, and (3) ensuring validity via a reproduction mechanism. Applying PuzzleClone, we construct PC-83K, a benchmark comprising over 83K diverse and programmatically validated puzzles. The generated puzzles span a wide spectrum of difficulty and formats, posing significant challenges to current state-of-the-art models. Experimental results show that post training (SFT and RL) on PC-83K yields substantial improvements not only on the testset but also on various logic and mathematical benchmarks. Post training raises average performance on PC-83K from 14.5 to 66.0 and delivers consistent improvements across 7 logic and mathematical benchmarks up to 18.4 absolute percentage points (SATBench from 51.6 to 70.0). Our code and data are available at https://github.com/HiThink-Research/PuzzleClone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。