arXiv:2605.21630cs.AI2026-05

通过组合思维模式生成高难度推理数据,提升模型训练效果。

MindLoom: Composing Thought Modes for Frontier-Level Reasoning Data Synthesis

论文配图:MindLoom: Composing Thought Modes for Frontier-Level Reasoning Data Synthesis
图 1 · 摘自论文原文
  • 将难题拆解为思维模式链,构建可组合的推理生成框架。
  • 在9个基准上提升模型性能,优于基线与外部数据训练结果。
  • 适合需要高质量推理数据的AI研究者与教育技术开发者。

尽管大语言模型在推理方面取得显著进展,系统性生成前沿水平的推理数据仍具挑战。现有方法对影响问题难度的结构因素缺乏洞察,导致多样性不足且难度控制不稳定。本文将问题难度视为原子知识-推理转换的累积,提出名为MindLoom的框架,通过组合式思维模式工程合成前沿推理数据。给定一组具有验证答案的难题,MindLoom首先将解法分解为揭示问题构造逻辑的思维模式链;随后训练检索模型,将问题状态匹配到兼容的思维模式,指导合成过程中的推理挑战引入。新问题通过迭代应用检索到的思维模式于初始问题,并采用分布对齐采样以促进多样推理覆盖。最后,通过基于滚动生成的评判阶段标注问题难度,并提供正确答案用于监督微调。我们在涵盖五个科学与工程学科及四项数学推理任务的九个基准上评估了MindLoom,使用不同模型家族和规模进行测试。在报告的基准上,经由MindLoom生成数据微调的模型表现优于基础模型、蒸馏模型及外部数据基线。消融实验验证各组件贡献,进一步分析表明MindLoom覆盖广泛推理模式,同时保持有效难度控制。实现已开源至https://github.com/EachSheep/MindLoom。

原文摘要 · Abstract (English)

Although LLMs have made substantial progress in reasoning, systematically producing frontier-level reasoning data remains difficult. Existing synthesis methods often have limited visibility into the structural factors that govern problem difficulty, which can result in narrow diversity and unstable difficulty control. In this work, we view the difficulty of a reasoning problem as arising from the accumulation of atomic knowledge-reasoning transformations, which we term thought modes. Building on this perspective, we propose MindLoom, a framework for synthesizing frontier-level reasoning data through compositional thought mode engineering. Given a collection of hard problems with verified solutions, MindLoom first decomposes those solutions into thought mode chains that reveal each problem's construction logic. It then trains a retrieval model that matches problem states to compatible thought modes, providing guidance on which reasoning challenges to introduce during synthesis. New problems are composed by iteratively applying retrieved thought modes to seed questions, with distribution-aligned sampling to encourage diverse reasoning coverage. Finally, a rollout-based judging stage labels generated questions by difficulty and supplies judged-correct responses for supervised fine-tuning. We evaluate MindLoom on nine benchmarks covering five STEM disciplines and four mathematical reasoning tasks across multiple model families and sizes. Models fine-tuned on MindLoom-generated data achieves favorable performances over base models, distillation, and external-data baselines across the reported benchmarks. Ablation studies indicate the contribution of each component, and further analysis suggests that MindLoom covers a broad range of reasoning patterns while maintaining useful difficulty control. We have open-sourced our implementation at https://github.com/EachSheep/MindLoom.

推理生成思维模式数据合成大模型训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。