arXiv:2605.26195cs.CRcs.AI2026-05

让安全大模型自动优化自身框架,提升攻防任务成功率。

CyberEvolver: Structured Self-Evolution for Cybersecurity Agents On the Fly

论文配图:CyberEvolver: Structured Self-Evolution for Cybersecurity Agents On the Fly
图 1 · 摘自论文原文
  • 通过结构化分层架构实现框架的自我迭代优化
  • 在攻防任务中平均提升13.6%成功率,超越人类设计方案
  • 适合需要自适应演化的自动化安全测试场景

基于大模型的安全代理广泛应用于网络安全任务,但现有系统多依赖固定的人工设计框架,在面对多样目标和失败模式时难以适应。本文提出「CyberEvolver」——一种可现场自演化的安全代理框架,能根据失败执行经验迭代优化自身框架。该方法克服了框架修改空间无序、执行反馈稀疏且被环境干扰、低多样性更新导致错误累积等挑战,采用四层可演化架构将框架优化分解为结构化组件,引入日志转诊断机制将噪声执行日志转化为可操作的修改信号,并结合种群式束搜索策略在进化中保持多样代理变体。我们在CTF挑战、漏洞利用及渗透测试任务上评估该框架,使用四个开源LLM进行测试。结果表明,相比初始代理,其平均成功率提升13.6%,优于六种人工设计的安全代理以及两种来自其他领域的自改进方法。这表明框架自演化是构建适应性安全测试大模型的重要方向。

原文摘要 · Abstract (English)

LLM-based agents are increasingly used for cybersecurity tasks, but most existing systems rely on fixed, human-designed scaffolds that struggle to adapt across diverse targets and failure modes. We introduce \textsc{CyberEvolver}, a self-evolving cybersecurity agent framework that iteratively revises its own scaffold based on experience from failed execution attempts. Self-evolution in cybersecurity is challenging because the space of possible scaffold changes is largely unstructured, execution feedback is sparse and often obscured by the environment, and low-diversity updates can cause errors to compound over repeated iterations. \textsc{CyberEvolver} addresses these challenges with a four-layer evolvable agent architecture that decomposes scaffold optimization into structured components, a trace-to-diagnosis mechanism that converts noisy execution logs into actionable revision signals, and a population-based beam search strategy that preserves diverse agent variants during evolution. We evaluate \textsc{CyberEvolver} on CTF challenges, vulnerability exploitation, and penetration-testing tasks using four open-source LLMs. Across these settings, \textsc{CyberEvolver} improves the seed agent's success rate by $13.6$\,\% on average, and outperforms six human-designed cybersecurity agents as well as two self-improvement methods adapted from other domains. These results suggest that scaffold self-evolution is a promising direction for building adaptive LLM agents for security testing.

安全代理自演化LLM应用渗透测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。