用可执行代码生成可验证的物理推理题,解决数据稀缺难题
Infinite Problem Generator: Verifiably Scaling Physics Reasoning Data with Agentic Workflows
- 通过代码形式构建物理问题,确保数学一致性
- 生成1335道题,平均每题含3.05个公式,覆盖102种物理公式
- 发现公式数与代码长度强相关,可精准控制题目难度
训练大模型进行复杂推理受限于高质量、可验证数据的稀缺。在物理领域,传统文本增强易引入幻觉,静态基准又缺乏微调所需推理链。我们提出无限问题生成器(IPG),一种基于公式即代码范式的智能体框架,可生成保证可解性的物理问题。不同于概率性文本生成,IPG将求解过程构建为可执行的Python程序,强制数学一致性。作为概念验证,我们发布了ClassicalMechanicsV1,一个从165个专家种子扩展出的1335道经典力学问题高保真语料库。该语料库具有高度结构多样性,涵盖102种独特物理公式,平均每个问题包含3.05个公式。我们还发现复杂度蓝图,公式数量与验证代码长度间存在强线性相关性(R² ≈ 0.95),确立代码复杂度为无需代理的精确难度度量,支持可控课程生成。我们开放了完整IPG流程、ClassicalMechanicsV1数据集及评估报告,以推动推理密集型领域的可复现研究。
原文摘要 · Abstract (English)
Training large language models for complex reasoning is bottlenecked by the scarcity of verifiable, high-quality data. In domains like physics, standard text augmentation often introduces hallucinations, while static benchmarks lack the reasoning traces required for fine-tuning. We introduce the Infinite Problem Generator (IPG), an agentic framework that synthesizes physics problems with guaranteed solvability through a Formula-as-Code paradigm. Unlike probabilistic text generation, IPG constructs solutions as executable Python programs, enforcing strict mathematical consistency. As a proof-of-concept, we release ClassicalMechanicsV1, a high-fidelity corpus of 1,335 classical mechanics problems expanded from 165 expert seeds. The corpus demonstrates high structural diversity, spanning 102 unique physical formulas with an average complexity of 3.05 formulas per problem. Furthermore, we identify a Complexity Blueprint, demonstrating a strong linear correlation ($R^2 \approx 0.95$) between formula count and verification code length. This relationship establishes code complexity as a precise, proxy-free metric for problem difficulty, enabling controllable curriculum generation. We release the full IPG pipeline, the ClassicalMechanicsV1 dataset, and our evaluation report to support reproducible research in reasoning-intensive domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。