arXiv:2603.13023cs.SEcs.AI2026-03被引 13

构建了全球最大开源代码工程训练环境,支持自动化代码迭代与验证。

daVinci-Env: Open SWE Environment Synthesis at Scale

  • 用多智能体流水线在64节点集群上自动生成4.5万+可执行Docker环境
  • 筛选出约9000个高质量环境,生成1.3万条训练轨迹,提升学习效率
  • 适用于大模型代码能力训练,尤其适合追求真实工程反馈的研究者

训练具备能力的软件工程(SWE)智能体需要大规模、可执行且可验证的环境,以提供动态反馈支持代码迭代、测试执行和解法优化。然而,现有开源数据集规模有限、仓库多样性不足,而工业级方案则因闭源和未公开基础设施形成研究壁垒。本文提出OpenSWE,目前最大且完全透明的Python SWE代理训练框架,包含45,320个可执行Docker环境,覆盖超过12.8k个仓库,所有Dockerfile、评估脚本和基础设施均开源,确保可复现性。OpenSWE通过部署在64节点分布式集群上的多智能体合成管道,自动完成仓库探索、Dockerfile构建、评估脚本生成及迭代测试分析。除规模外,提出以质量为核心的过滤流程,识别并剔除无法求解或挑战度不足的环境,仅保留能最大化学习效率的实例。项目总投入约147万美元(89.1万用于环境构建,57.6万用于轨迹采样与难度感知筛选),最终产出约13,000条经筛选的训练轨迹,来自约9,000个质量保障环境。大量实验验证其有效性:OpenSWE-32B与OpenSWE-72B在SWE-bench Verified上分别达到62.4%与66.0%,超越Qwen2.5系列现有最优表现。此外,专精于SWE的训练还带来显著跨领域提升,数学推理最高提升12分,科学基准提升5分,且未降低事实记忆能力。

原文摘要 · Abstract (English)

Training capable software engineering (SWE) agents demands large-scale, executable, and verifiable environments that provide dynamic feedback loops for iterative code editing, test execution, and solution refinement. However, existing open-source datasets remain limited in scale and repository diversity, while industrial solutions are opaque with unreleased infrastructure, creating a prohibitive barrier for most academic research groups. We present OpenSWE, the largest fully transparent framework for SWE agent training in Python, comprising 45,320 executable Docker environments spanning over 12.8k repositories, with all Dockerfiles, evaluation scripts, and infrastructure fully open-sourced for reproducibility. OpenSWE is built through a multi-agent synthesis pipeline deployed across a 64-node distributed cluster, automating repository exploration, Dockerfile construction, evaluation script generation, and iterative test analysis. Beyond scale, we propose a quality-centric filtering pipeline that characterizes the inherent difficulty of each environment, filtering out instances that are either unsolvable or insufficiently challenging and retaining only those that maximize learning efficiency. With $891K spent on environment construction and an additional $576K on trajectory sampling and difficulty-aware curation, the entire project represents a total investment of approximately $1.47 million, yielding about 13,000 curated trajectories from roughly 9,000 quality guaranteed environments. Extensive experiments validate OpenSWE's effectiveness: OpenSWE-32B and OpenSWE-72B achieve 62.4% and 66.0% on SWE-bench Verified, establishing SOTA among Qwen2.5 series. Moreover, SWE-focused training yields substantial out-of-domain improvements, including up to 12 points on mathematical reasoning and 5 points on science benchmarks, without degrading factual recall.

代码生成SWE大模型训练开源数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。