arXiv:2608.05148cs.CL2026-08

构建大规模可验证推理数据集,提升模型推理能力。

Reasoning Core: Designing Broad Procedural Data for Completion-Supervised Reasoning Training

  • 设计50个跨领域程序化生成器,支持可控难度与语义评分。
  • 在3B模型上超越其他数据集,在DROP、LogiQA等任务上表现最优。
  • 强调目标紧凑性与难度校准,适合训练增强型推理模型。

程序化生成器可大规模生成可验证的推理问题,但作为补全监督微调数据仍较少被关注。本文提出Reasoning Core,包含覆盖数学、逻辑、规划、状态追踪、形式语言、结构化数据、游戏、因果关系和代码等领域的50个生成器,配备语义评分器、难度控制机制和任务评估工具。在匹配的补全监督协议下,我们在四个基础模型设置和多个训练周期中对比Reasoning Core与Procedural Warmup、Reasoning Gym及SynLogic。在主实验(3B模型)中,Reasoning Core在DROP、LogiQA和ARC-Challenge上的平均得分最高,优于无程序化数据的基线及其余三个替代数据集。任务级分析表明,仅保证语义正确性不足以确保训练有效性,紧凑的目标与校准的难度是关键设计因素。我们通过模型辅助审查、人工裁定与回归测试进行审计,发现生成、渲染、目标与评分之间存在细微不一致,提醒程序化生成本身不能保证正确性。该库、生成数据集与审计材料均已公开。

原文摘要 · Abstract (English)

Procedural generators produce useful verifiable reasoning problems at scale, but have received less attention as data for completion-supervised fine-tuning. We introduce Reasoning Core, a collection of 50 generators spanning mathematics, logic, planning, state tracking, formal languages, structured data, games, causality, and code, with semantic scorers, difficulty controls, and task evaluators. Under a matched completion-supervised protocol, we compare Reasoning Core with Procedural Warmup, Reasoning Gym, and SynLogic across four base-model settings and multiple training durations. In the primary 3B comparison, Reasoning Core achieves the highest mean scores on DROP, LogiQA, and ARC-Challenge, exceeding both the baseline without procedural data and all three alternative procedural collections. Task-level analyses show that semantic validity alone does not ensure training utility, highlighting compact targets and calibrated difficulty as important design factors. We ran audits combining model-assisted review, human adjudication, and regression testing. Applied throughout Reasoning Core development and to the other collections, they reveal subtle mismatches among generation, rendering, targets, and scoring, a reminder that procedural generation alone does not guarantee correctness. The library, generated datasets, and audit material are publicly available.

推理训练程序生成数据质量可验证性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。