arXiv:2606.24855cs.AI2026-06被引 4

开源训练数据流水线,提升智能体模型跨任务能力

OpenThoughts-Agent: Data Recipes for Agentic Models

论文配图:OpenThoughts-Agent: Data Recipes for Agentic Models
图 1 · 摘自论文原文
  • 构建全流程开源数据管道,系统验证各环节对智能体性能的影响
  • 用10万条数据微调后,在7个基准上平均准确率达44.8%,提升3.9个百分点
  • 数据可复现、具规模效应,适合研究智能体训练与开放实验的团队

智能体语言模型显著拓展了AI应用边界,但如何构建通用智能体的训练数据仍不明确。现有开源工作如SWE-Smith、SERA和Nemotron-Terminal多聚焦单一基准,难以支持跨任务泛化。本文提出OpenThoughts-Agent(OT-Agent)项目,提供完整的开源数据构建流水线。通过超过100次受控消融实验,系统分析流水线各阶段影响,揭示任务来源与多样性的重要性。最终基于该流水线构建包含10万例的数据集,对Qwen3-32B进行微调,在七个智能体基准上实现44.8%的平均准确率,较最强现有开源模型(Nemotron-Terminal-32B,40.9%)提升3.9个百分点。此外,数据集在计算可控对比中,无论训练集大小均表现更优。项目已将训练集、数据流水线、实验数据及模型公开于openthoughts.ai,以支持未来开放研究。

原文摘要 · Abstract (English)

Agentic language models dramatically expand the applications of AI yet little is publicly known about how to curate training data for broadly capable agents. Existing open efforts such as SWE-Smith, SERA, and Nemotron-Terminal typically target a single benchmark, leaving open the question of how to train models that generalize across diverse agentic tasks. The OpenThoughts-Agent (OT-Agent) project addresses this gap with a fully open data curation pipeline for training agentic models. We conduct more than 100 controlled ablation experiments to systematically investigate each stage of the pipeline, yielding insights on the importance of task sources and diversity. We then assemble a training set of 100K examples from our pipeline and fine-tune Qwen3-32B on this dataset, which yields an average accuracy of 44.8% across seven agentic benchmarks and a 3.9 percentage point improvement over the strongest existing open data agentic model (Nemotron-Terminal-32B, 40.9%). Moreover, our training data exhibits strong scaling properties, outperforming alternative open datasets at every training set size in compute-controlled comparisons. We publicly release our training sets, data pipeline, experimental data, and models at openthoughts.ai to support future open research on agentic model training.

智能体数据构建开源微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。