用认知原子生成奥数级数学题,可控且多样。
CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models
- 将解题过程拆解为基本认知单元,再重组生成新题。
- 生成题目难度接近AIME,结构变化超过现有方法。
- 适合需要高质量数学题的数据集构建与模型训练。
数学推理对大语言模型构成挑战,因其需多步推理与抽象概念整合。现有测试时扩展技术依赖高质量难题,但奥数级题源稀缺。本文提出CogAtom框架,基于认知原子合成严谨且认知多样化的数学问题。不同于以往方法,该框架将问题构造视为从人类解题中提取的基本推理单元——认知原子的选取与重组过程。通过促进多样性的随机游走算法探索认知原子空间,结合约束性重组机制确保逻辑严谨与结构有效。图结构的组合特性带来近乎无限的推理路径,游走算法系统化探索该空间,实现大规模高质量问题生成;同时通过控制认知原子数量,可精确调节题目难度,保障生成题目的多样性、可扩展性与可控性。实验表明,CogAtom在准确率、推理深度与多样性上均优于现有方法,生成题目难度接近但结构变体超越AIME。本工作为可扩展、高质量数学题生成提供了认知基础路径。代码已开源:https://github.com/Icarus-1111/CogAtom。
原文摘要 · Abstract (English)
Mathematical reasoning poses significant challenges for Large Language Models (LLMs) due to its demand for multi-step reasoning and abstract conceptual integration. While recent test-time scaling techniques rely heavily on high-quality, challenging problems, the scarcity of Olympiad-level math problems remains a bottleneck. We introduce CogAtom, a novel cognitive atom-based framework for synthesizing mathematically rigorous and cognitively diverse problems. Unlike prior approaches, CogAtom models problem construction as a process of selecting and recombining fundamental reasoning units, cognitive atoms, extracted from human-authored solutions. A diversity-promoting random walk algorithm enables exploration of the cognitive atom space, while a constraint-based recombination mechanism ensures logical soundness and structural validity. The combinatorial nature of the graph structure provides a near-infinite space of reasoning paths, and the walk algorithm systematically explores this space to achieve large-scale synthesis of high-quality problems; meanwhile, by controlling the number of cognitive atoms, we can precisely adjust problem difficulty, ensuring diversity, scalability, and controllability of the generated problems. Experimental results demonstrate that CogAtom outperforms existing methods in accuracy, reasoning depth, and diversity, generating problems that closely match the difficulty of AIME while exceeding it in structural variation. Our work offers a cognitively grounded pathway toward scalable, high-quality math problem generation.Our code is publicly available at https://github.com/Icarus-1111/CogAtom.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。