arXiv:2603.20691cs.SEcs.AI2026-03被引 7

构建可扩展的代码工程任务数据集,提升智能体训练效率

SWE-Next: Scalable Real-World Software Engineering Tasks for Agents

  • 从真实合并请求中挖掘可执行任务,仅保留测试性能严格提升的实例
  • 用30小时和639GB存储处理3971个仓库,生成2308个自验证任务实例
  • 适合研究代码智能体训练的数据高效方法或自动化测试优化

可执行的软件工程数据对训练代码工程智能体具有重要价值,但规模化面临两大挑战:仅有少量真实仓库变更产生可验证、高信号的任务实例;直接为每个仓库构建环境会迅速成为系统瓶颈。本文提出SWE-Next,一个面向可扩展代码工程任务与轨迹收集的执行驱动框架。数据层面,SWE-Next挖掘真实合并的Pull Request,执行候选基线/合并提交对,仅保留测试性能严格提升且无回归的实例,实现自验证。同时引入严格提交准入机制,确保轨迹基于实证而非推测。系统层面,提出可复用的repo-quarter配置文件,在时间相近的提交间共享环境,保持每项任务独立可复现。仅使用30小时和639GB环境存储,处理3,971个种子仓库及102,582个候选提交对,构建出包含2,308个自验证实例的数据集。实验表明,相比基准方法,SWE-Next在更少或相当数量的训练轨迹下仍能提升下游pass@1表现,说明其优势并非来自更强的轨迹生成器,而是更高信号的执行驱动监督与更高效的采集机制。

原文摘要 · Abstract (English)

Executable software engineering data is valuable for training SWE agents, but scaling it remains difficult for two reasons: only a small fraction of real repository changes yield verifiable, high-signal task instances, and naively building repository-specific environments quickly becomes the dominant systems cost. We present SWE-Next, an execution-grounded framework for scalable SWE task and trajectory collection. On the data side, SWE-Next mines real merged pull requests, executes candidate base/merged commit pairs, and retains only those that produce strict test improvements without regressions, yielding self-verifying instances. It also applies strict submission gating so that collected trajectories remain evidence-driven rather than speculative. On the systems side, SWE-Next introduces reusable repo-quarter profiles, which reuse the same environment across nearby commits in time while keeping each task run separate and reproducible. Using only 30 hours and 639GB of environment storage, SWE-Next processes 3,971 seed repositories and 102,582 candidate commit pairs mined from real merged PRs to construct a dataset of 2,308 self-verifying instances. Experiments show that SWE-Next improves downstream pass@1 with fewer or comparable training trajectories, indicating that its gains come not from a stronger trajectory generator, but from higher-signal execution-grounded supervision and more efficient data collection.

代码智能体数据构建自动化测试可扩展性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。