用智能代理框架自动分类攻击并生成可信报告,减少误报。
CyberRAG: An Agentic RAG cyber attack classification and reporting tool
- 设计多模块代理系统,动态检索与推理,精准识别攻击类型。
- 在三种攻击上准确率达94.92%,解释内容获专家高度评价。
- 适合安全运营中心(SOC)快速响应,可灵活扩展新攻击类型。
大型企业中的入侵检测与防御系统每小时可生成数十万条警报,分析师面临信息过载和持续更新的专业知识要求。传统机器学习检测器虽能减少警报数量,但仍存在大量误报;而标准检索增强生成(RAG)管道常召回无关上下文,难以提供可靠解释。本文提出CyberRAG,一种基于智能体的模块化RAG框架,实现对网络攻击的实时分类、解释生成与结构化报告。核心大模型代理协调三类组件:(i) 针对不同攻击家族微调的专用分类器;(ii) 用于信息增强与告警的工具适配器;(iii) 迭代式检索-推理循环,持续查询领域知识库直至证据相关且自洽。与传统RAG不同,CyberRAG采用智能体架构,支持动态控制流与自适应推理。该系统可自主优化威胁标签与自然语言解释,显著降低误报率,提升可解释性。系统具备可扩展性:新增攻击类型仅需添加分类器,无需重训核心代理。在SQL注入、XSS和SSTI攻击上的评估显示,单类准确率超94%,综合分类准确率达94.92%。生成解释的BERTScore达0.94,经GPT-4专家评估得4.9/5分,对对抗性与未见载荷保持鲁棒性。结果表明,面向专业领域的智能体式RAG可兼顾高检测精度与可信、适用于安全运营中心的文本输出,为部分自动化网络安全防御提供灵活路径。
原文摘要 · Abstract (English)
Intrusion Detection and Prevention Systems (IDS/IPS) in large enterprises can generate hundreds of thousands of alerts per hour, overwhelming analysts with logs requiring rapidly evolving expertise. Conventional machine-learning detectors reduce alert volume but still yield many false positives, while standard Retrieval-Augmented Generation (RAG) pipelines often retrieve irrelevant context and fail to justify predictions. We present CyberRAG, a modular agent-based RAG framework that delivers real-time classification, explanation, and structured reporting for cyber-attacks. A central LLM agent orchestrates: (i) fine-tuned classifiers specialized by attack family; (ii) tool adapters for enrichment and alerting; and (iii) an iterative retrieval-and-reason loop that queries a domain-specific knowledge base until evidence is relevant and self-consistent. Unlike traditional RAG, CyberRAG adopts an agentic design that enables dynamic control flow and adaptive reasoning. This architecture autonomously refines threat labels and natural-language justifications, reducing false positives and enhancing interpretability. It is also extensible: new attack types can be supported by adding classifiers without retraining the core agent. CyberRAG was evaluated on SQL Injection, XSS, and SSTI, achieving over 94\% accuracy per class and a final classification accuracy of 94.92\% through semantic orchestration. Generated explanations reached 0.94 in BERTScore and 4.9/5 in GPT-4-based expert evaluation, with robustness preserved against adversarial and unseen payloads. These results show that agentic, specialist-oriented RAG can combine high detection accuracy with trustworthy, SOC-ready prose, offering a flexible path toward partially automated cyber-defense workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。