用可执行的漏洞挖掘环境训练大模型,性能超越主流基线。
Training Language Model Agents to Find Vulnerabilities with CTF-Dojo
- 构建可复现的容器化漏洞挑战平台,支持自动部署与验证。
- 仅用486条真实轨迹训练,模型在3个基准上提升11.6%准确率。
- 适合安全研究、AI Agent开发人员快速构建实战型智能体。
大型语言模型(LLMs)在可执行运行时环境中训练时表现出卓越能力,尤其在软件工程任务中通过可验证反馈循环取得显著成效。然而,大规模且通用的执行基础环境仍稀缺,限制了更强大机器学习智能体的发展。本文提出CTF-Dojo,首个大规模可执行运行时环境,包含658个完整功能的捕获旗帜(CTF)风格挑战,全部以Docker容器化,确保可复现性。为实现快速扩展,我们开发CTF-Forge自动化流水线,可在数分钟内将公开资源转化为可用执行环境,取代以往需数周专家配置的传统方式。仅使用486条高质量、执行验证过的轨迹训练的LLM智能体,在三个竞争性基准(InterCode-CTF、NYU CTF Bench、Cybench)上相比强基线最高获得11.6%的绝对性能提升。表现最佳的32B模型达到31.9% Pass@1,创下开源权重新纪录,媲美DeepSeek-V3-0324和Gemini-2.5-Flash等前沿模型。通过将CTF任务作为执行智能体学习的基准,CTF-Dojo证明:执行基础训练信号不仅有效,更是推动高性能机器学习智能体发展的关键,且无需依赖昂贵专有系统。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated exceptional capabilities when trained within executable runtime environments, notably excelling at software engineering tasks through verified feedback loops. Yet, scalable and generalizable execution-grounded environments remain scarce, limiting progress in training more capable ML agents. We introduce CTF-Dojo, the first large-scale executable runtime tailored for training LLMs with verifiable feedback, featuring 658 fully functional Capture-The-Flag (CTF)-style challenges containerized in Docker with guaranteed reproducibility. To enable rapid scaling without manual intervention, we develop CTF-Forge, an automated pipeline that transforms publicly available artifacts into ready-to-use execution environments in minutes, eliminating weeks of expert configuration traditionally required. We trained LLM-based agents on just 486 high-quality, execution-verified trajectories from CTF-Dojo, achieving up to 11.6% absolute gains over strong baselines across three competitive benchmarks: InterCode-CTF, NYU CTF Bench, and Cybench. Our best-performing 32B model reaches 31.9% Pass@1, establishing a new open-weight state-of-the-art that rivals frontier models like DeepSeek-V3-0324 and Gemini-2.5-Flash. By framing CTF-style tasks as a benchmark for executable-agent learning, CTF-Dojo demonstrates that execution-grounded training signals are not only effective but pivotal in advancing high-performance ML agents without dependence on costly proprietary systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。