提出MAESTRO框架,系统分析智能代理在网管中的安全风险。
Securing Agentic AI: Threat Modeling and Risk Analysis for Network Monitoring Agentic AI System
- 构建七层威胁模型,识别代理系统的潜在漏洞。
- 实测发现重放攻击致延迟,日志篡改引发计算负载上升。
- 适合关注AI系统安全的开发者与网络安全研究人员。
将大语言模型与自主代理结合用于网络监控与决策系统时,会引发严重安全问题。本研究提出MAESTRO框架,采用七层威胁建模架构,暴露、评估并消除智能代理系统的漏洞。构建了基于Python、LangChain和WebSocket遥测的原型系统,集成推理、记忆、参数调优与异常检测模块。验证了两类实际威胁:(i) 通过流量重放发起拒绝服务攻击;(ii) 篡改代理维护的历史日志文件导致内存污染。这两类攻击均造成可测量的性能下降,表现为遥测更新延迟及计算负载增加,源于系统适应能力恶化。建议采用多层纵深防御策略,包括内存隔离、规划器实时验证及异常响应机制。结果表明MAESTRO可用于实际威胁映射、风险评分及韧性系统设计。作者强调需强化内存完整性、监控自适应逻辑,并保护跨层通信,以保障智能代理在对抗环境下的可靠性。
原文摘要 · Abstract (English)
When combining Large Language Models (LLMs) with autonomous agents, used in network monitoring and decision-making systems, this will create serious security issues. In this research, the MAESTRO framework consisting of the seven layers threat modeling architecture in the system was used to expose, evaluate, and eliminate vulnerabilities of agentic AI. The prototype agent system was constructed and implemented, using Python, LangChain, and telemetry in WebSockets, and deployed with inference, memory, parameter tuning, and anomaly detection modules. Two practical threat cases were confirmed as follows: (i) resource denial of service by traffic replay denial-of-service, and (ii) memory poisoning by tampering with the historical log file maintained by the agent. These situations resulted in measurable levels of performance degradation, i.e. telemetry updates were delayed, and computational loads were increased, as a result of poor system adaptations. It was suggested to use a multilayered defense-in-depth approach with memory isolation, validation of planners and anomaly response systems in real-time. These findings verify that MAESTRO is viable in operational threat mapping, prospective risk scoring, and the basis of the resilient system design. The authors bring attention to the importance of the enforcement of memory integrity, paying attention to the adaptation logic monitoring, and cross-layer communication protection that guarantee the agentic AI reliability in adversarial settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。