用需求生成任务,让大模型智能体训练数据自动扩展。
NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMs

- 根据能力需求自动生成多样化可执行任务和专家轨迹。
- 无需人工设计工具链,3.6千终端任务使模型性能提升至52%。
- 适合想低成本构建高效智能体的开发者与研究者。
LLM智能体训练数据的规模化受限于依赖特定基础设施的任务生成方式:扩展覆盖需手动工程、新领域需定制流程,且任务分布常受底座偏差影响。本文提出NexForge,一种需求驱动的框架,输入高层次能力要求后,通过分析真实需求构建场景与任务画像,并进行分布感知编译生成任务指令。针对每条指令,自动获取或构建所需文件、依赖与运行配置,最终收集专家回放生成训练轨迹。无需领域专用基础设施,即可生成3.6K终端任务与2K办公任务,使Qwen3.5-35B-A3B Base在Terminal-Bench 2.0上表现从22.5%提升至52.0%,在GDPval上从813提升至1338 Elo;进一步扩展至43.2K终端任务时达58.4%,接近配备Claude Code的Claude Opus 4.6水平。基于此数据训练的Nex-N2系列模型,将Qwen3.5-397B-A17B在Terminal-Bench 2.1上提升至75.3%,在GDPval上达1585 Elo,达到开源最优,超越多个前沿闭源系统。相关模型已公开:https://nex.sii.edu.cn/
原文摘要 · Abstract (English)
Scaling executable agent training data for LLM post-training is bottlenecked by substrate-bound methods that tie task generation to predefined tools, repositories, or skill graphs: expanding coverage requires manual substrate engineering, each new domain demands a bespoke pipeline, and the resulting task distributions often reflect substrate biases rather than real-world demand. We introduce NexForge, a requirement-driven framework that takes high-level capability requirements as input and synthesizes diverse, executable agent tasks and expert trajectories for SFT. NexForge first investigates real-world demand to construct scenarios and task profiles, then performs distribution-aware compilation to generate task directives. For each directive, NexForge automatically retrieves or constructs the required files, dependencies, and runtime configurations, and finally collects expert rollouts to produce training trajectories. Without domain-specific infrastructure, NexForge produces 3.6K terminal and 2K office tasks, improving Qwen3.5-35B-A3B Base from 22.5\% to 52.0\% on Terminal-Bench 2.0 and from 813 to 1338 Elo on GDPval; scaling further to 43.2K terminal tasks yields 58.4\%, on par with Claude Opus 4.6 equipped with Claude Code. Scaled further, NexForge-synthesized data contributes to the training of Nex-N2, a family of publicly available agent models that lift Qwen3.5-397B-A17B to 75.3\% on Terminal-Bench 2.1 and to 1585 Elo on GDPval---achieving state-of-the-art open-source performance and surpassing several frontier proprietary systems. Nex-N2 models are available at https://nex.sii.edu.cn/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。