用智能体与语义缓存防御提示注入,兼顾安全、透明与环保。
Prompt Injection Mitigation with Agentic AI, Nested Learning, and AI Sustainability via Semantic Caching
- 构建多智能体系统,通过语义缓存减少41.6%的LLM调用
- 零高危漏洞,实现安全与推理透明性的平衡
- 适合关注安全部署、绿色计算的工程师和研究者
提示注入仍是大语言模型安全部署的核心挑战,尤其在多智能体环境中,中间输出可能传播或放大恶意指令。本文在前期提出的四维度总注入脆弱性评分(TIVS)基础上,引入基于语义相似性的缓存机制和第五个指标(可观测性得分比,OSR),形成TIVS-O评估框架,研究防御效果与透明度的交互关系。系统采用受HOPE启发的嵌套学习架构,结合智能体流水线与连续记忆系统,在301个合成注入提示(来自10类攻击)上实现语义相似性缓存;第四智能体使用五个关键指标进行综合安全分析。除传统注入指标外,OSR量化各智能体暴露的安全相关推理的丰富性与清晰度,可显式分析严格防护与可审计性之间的权衡。实验表明,系统实现零高风险泄露,语义缓存带来41.6%的LLM调用减少,显著降低延迟、能耗与碳排放。五种TIVS-O配置揭示了防护严格性与取证透明性间的最优权衡。结果表明,可观测性感知评估能揭示多智能体流程中的非单调效应,且记忆增强型智能体可在不修改模型权重的前提下,协同提升安全性、实时性能、运营成本节约与环境可持续性,为安全、绿色的生产级大模型部署提供可行路径。
原文摘要 · Abstract (English)
Prompt injection remains a central obstacle to the safe deployment of large language models, particularly in multi-agent settings where intermediate outputs can propagate or amplify malicious instructions. Building on earlier work that introduced a four-metric Total Injection Vulnerability Score (TIVS), this paper extends the evaluation framework with semantic similarity-based caching and a fifth metric (Observability Score Ratio) to yield TIVS-O, investigating how defence effectiveness interacts with transparency in a HOPE-inspired Nested Learning architecture. The proposed system combines an agentic pipeline with Continuum Memory Systems that implement semantic similarity-based caching across 301 synthetically generated injection-focused prompts drawn from ten attack families, while a fourth agent performs comprehensive security analysis using five key performance indicators. In addition to traditional injection metrics, OSR quantifies the richness and clarity of security-relevant reasoning exposed by each agent, enabling an explicit analysis of trade-offs between strict mitigation and auditability. Experiments show that the system achieves secure responses with zero high-risk breaches, while semantic caching delivers substantial computational savings, achieving a 41.6% reduction in LLM calls and corresponding decreases in latency, energy consumption, and carbon emissions. Five TIVS-O configurations reveal optimal trade-offs between mitigation strictness and forensic transparency. These results indicate that observability-aware evaluation can reveal non-monotonic effects within multi-agent pipelines and that memory-augmented agents can jointly maximize security robustness, real-time performance, operational cost savings, and environmental sustainability without modifying underlying model weights, providing a production-ready pathway for secure and green LLM deployments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。