arXiv:2607.27929cs.AI2026-07

用可执行任务自动生成任务,让大模型训练更高效。

Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training

论文配图:Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training
图 1 · 摘自论文原文
  • 让智能体在真实环境里自己生成、执行并验证任务
  • 仅用3221条数据就让模型通过率超30%
  • 适合做大规模强化学习训练的开发者

大规模终端智能体训练需要多样且可验证的终端任务和高质量交互轨迹,但获取此类数据仍是重大挑战。现有合成方法存在两大缺陷:(1)任务生成与真实执行脱节,可靠性弱;(2)依赖已有资源库,多样性与可扩展性受限。我们提出 Meta-Task 框架,将终端任务合成重新定义为一个终端基准格式的任务:智能体在真实容器环境中迭代生成、执行并验证任务,使合成内容在生成循环中自动检查内部一致性和可执行性。在此基础上,我们沿多维度解耦目标任务需求,引入多阶段机制动态设计新任务规范,再生成实际任务,并可选接入外部材料以增强多样性与真实性。我们还采用 LLM-as-Judge 进行过滤,确保训练数据质量。在 Terminal-Bench 2.0 上的实验表明,仅用 3,221 条由 Meta-Task 合成的轨迹进行微调,Qwen3-14B 和 Qwen3-32B 的 Avg Pass@1 分别达到 22.5% 和 31.8%,显著优于同期方法,且所需训练数据量更少。

原文摘要 · Abstract (English)

Training terminal agents at scale requires diverse, verifiable terminal tasks and high-quality interaction trajectories, yet acquiring such data remains a significant challenge. Existing synthesis methods face two key limitations: (1) weak reliability caused by the disconnect between task generation and real execution, and (2) limited diversity and scalability due to dependence on existing repositories. We propose Meta-Task, a framework that redefines terminal task synthesis as a Terminal-Bench-format task itself: an agent operates within a real container environment to iteratively generate, execute, and verify tasks, so that synthesized components are checked for internal consistency and executability within the generation loop itself. Building upon this, we decouple the target task requirements along multiple dimensions, introduce a multi-phase mechanism that dynamically designs novel task specifications before producing the actual tasks, and incorporate optional external material support to enhance diversity and realism. We additionally apply LLM-as-Judge filtering to ensure the quality of the final training data. Experiments on Terminal-Bench 2.0 show that fine-tuning on only 3,221 Meta-Task synthesized trajectories achieves 22.5% and 31.8% Avg Pass@1 for Qwen3-14B and Qwen3-32B respectively, outperforming concurrent approaches with significantly less training data.

智能体训练任务合成强化学习LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。