arXiv:2510.05605cs.CRcs.AI2025-10被引 15

用大模型自动执行渗透测试,减少人工干预,效果比现有工具更好。

AutoPentester: An LLM Agent-based Framework for Automated Pentesting

  • 基于大模型动态生成攻击策略,自动调用安全工具迭代执行。
  • 在靶机上实现27%更高的任务完成率和39.5%更广漏洞覆盖。
  • 适合安全团队快速部署,降低对专家经验的依赖。

渗透测试与漏洞评估是保障计算机系统安全的重要行业实践。随着网络威胁规模和复杂性的增长,渗透测试需求激增,远超人工专业人员的处理能力。尽管人工智能(特别是大语言模型,LLM)的发展推动了自动化渗透测试的尝试,但现有工具如PentestGPT仍需大量人工参与。为此,我们提出一种新型的基于大模型代理的自动化渗透测试框架AutoPentester。给定目标IP地址,AutoPentester可自动使用常见安全工具,通过迭代过程完成渗透测试,并根据前一轮工具输出动态生成攻击策略,模拟人类渗透测试员的行为。我们在Hack The Box和自建虚拟机上评估AutoPentester,与最先进的PentestGPT进行对比。结果表明,AutoPentester在子任务完成率上提升27.0%,漏洞覆盖率提高39.5%,且步骤更少。更重要的是,其所需的人工干预显著低于PentestGPT。此外,我们招募安全行业志愿者进行用户调查并开展定性分析,评估其与行业实践的契合度及与PentestGPT的对比。平均评分达到3.93/5,较PentestGPT高出19.8%。

原文摘要 · Abstract (English)

Penetration testing and vulnerability assessment are essential industry practices for safeguarding computer systems. As cyber threats grow in scale and complexity, the demand for pentesting has surged, surpassing the capacity of human professionals to meet it effectively. With advances in AI, particularly Large Language Models (LLMs), there have been attempts to automate the pentesting process. However, existing tools such as PentestGPT are still semi-manual, requiring significant professional human interaction to conduct pentests. To this end, we propose a novel LLM agent-based framework, AutoPentester, which automates the pentesting process. Given a target IP, AutoPentester automatically conducts pentesting steps using common security tools in an iterative process. It can dynamically generate attack strategies based on the tool outputs from the previous iteration, mimicking the human pentester approach. We evaluate AutoPentester using Hack The Box and custom-made VMs, comparing the results with the state-of-the-art PentestGPT. Results show that AutoPentester achieves a 27.0% better subtask completion rate and 39.5% more vulnerability coverage with fewer steps. Most importantly, it requires significantly fewer human interactions and interventions compared to PentestGPT. Furthermore, we recruit a group of security industry professional volunteers for a user survey and perform a qualitative analysis to evaluate AutoPentester against industry practices and compare it with PentestGPT. On average, AutoPentester received a score of 3.93 out of 5 based on user reviews, which was 19.8% higher than PentestGPT.

渗透测试大模型应用自动化安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。