arXiv:2607.10891cs.AI2026-07被引 8

构建大规模可验证终端环境,提升语言模型的命令行任务能力。

SETA: Scaling Environments for Terminal Agents

论文配图:SETA: Scaling Environments for Terminal Agents
图 1 · 摘自论文原文
  • 设计双管道框架,自动生成标准化终端强化学习环境。
  • 建成超4500个环境的数据集,8B模型在基准上达12%通过率。
  • 适合研究终端智能体、强化学习与自动化系统的人群。

大型语言模型正转向通过多样化界面(如网页和图形界面)执行任务的智能体。其中,命令行终端提供了一种通用的文本接口,涵盖系统操作、数据科学与机器学习等任务。然而,终端智能体训练的规模化仍面临挑战:需要多样且连贯的任务指令、可执行环境及可靠验证机制,却缺乏自然接地的监督数据。本文提出SETA框架,用于生成可验证的终端强化学习环境。该框架包含两个共享统一验证机制的管道:SETA-Synth将多种来源转换为标准强化学习环境;SETA-Evol则通过自适应调控难度与多样性,扩展现有环境。我们共同构建并发布目前最大的开源可验证终端强化学习数据集——SETA-Env,包含超过4,500个环境。在该数据集上,使用GRPO训练Qwen3-8B,使终端基准测试2.0的通过率达到12%,为8B规模模型中最高记录。同时,在相同智能体设置下,DeepSeek-V4-Flash的通过率从40%提升至43%(pass@1),pass@5从54%升至58%。结果表明,SETA-Env为终端智能体训练提供了高质量环境,是推动终端智能体学习研究的重要资源。

原文摘要 · Abstract (English)

Large language models (LLMs) are rapidly shifting toward agents that solve tasks through diverse interfaces, including web and graphical user interfaces (GUIs). Among these, the terminal command line provides a text-based, general-purpose interface, covering tasks from system operations to data science and machine learning. However, scaling terminal-agent training remains challenging, as it requires diverse and coherent task instructions, executable environments, and reliable verification, while lacking naturally grounded supervision data. In this work, we propose SETA, a scalable framework for generating verifiable terminal environments for reinforcement learning (RL). The framework consists of two pipelines sharing a unified verification mechanism: SETA-Synth converts diverse sources into standardized RL environments, and SETA-Evol further expands from existing environments with adaptive control of difficulty and diversity. Together, we construct and release SETA-Env, the largest open-source verifiable terminal RL dataset to date, containing over 4,500 environments. We evaluate our dataset by training Qwen3-8B with GRPO on SETA-Env, achieving 12% pass rate on Terminal-Bench 2.0, the best reported result for an RL-trained model at the 8B scale. We further observe gains on DeepSeek-V4-Flash under the same terminal agent harness, with pass@1 on Terminal-Bench 2.0 improving from 40% to 43% and pass@5 improving from 54% to 58%. These results demonstrate that SETA- Env provides high-quality training environments for terminal agents and serves as a valuable resource for advancing research on terminal-based agent learning.

终端智能体强化学习数据集命令行

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。