为智能体AI构建可扩展的安全防护框架,实时拦截多种攻击威胁。
SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classification

- 基于NSFA分类体系,系统化组织185种安全风险。
- 4个参数量从0.8B到9B的模型均达94%以上F1分数。
- 支持插件式部署,可扩展至原设计之外的风险场景。
我们提出nsfaguard,一个用于保护智能体AI系统免受操作威胁的安全防护框架,包括提示注入、敏感信息提取、恶意代码请求、危险工具滥用和资源耗尽等。首先引入NSFA分类体系,将185种风险变体按CIA三元组结构化组织,并与三个主流OWASP指南交叉验证。基于此,构建涵盖133种语言的基准测试集,包含超过9.3万条专为用户查询和代理响应设计的样本,以及3,435条来自五个公开智能体安全数据集的跨源样本。为实现实际威胁检测,我们开发双模式方法:基于SFT的生成式推理用于可解释的离线审计,结合冻结主干网络的判别分类头,实现实时检测,延迟约50ms。我们发布了四个参数量分别为0.8B、2B、4B和9B的模型,所有模型在自建基准上均达到≥94% F1,在跨源评估中,9B模型取得91.29% F1,且精度-召回权衡更优。消融实验表明,分类头可使防护系统具备超出原始范围的风险识别能力,性能达到当前最优。结果证明该方法具有高度可扩展性与通用性,可作为即插即用的增强模块。
原文摘要 · Abstract (English)
We present nsfaguard, a guardrail framework for securing agentic AI systems against operational threats, such as prompt injection, sensitive information extraction, malicious code requests, dangerous tool misuse, and resource exhaustion. We first introduce the NSFA taxonomy, which organizes 185 risk variants into a CIA-triad-grounded hierarchy and is cross-validated against three well-established OWASP guidelines. Based on this taxonomy, we construct a benchmark suite spanning 133 languages, comprising over 93K purpose-built samples targeting both user queries and agent responses, along with 3,435 cross-source samples adapted from five public agent-security datasets. To detect these operational threats in practice, we develop a dual-mode approach combining SFT-based generative reasoning for interpretable offline auditing with discriminative classification heads on the frozen backbone, enabling real-time detection at approximately 50,ms. We release four models with 0.8B, 2B, 4B, and 9B parameters, all achieving $\geq$94% F1 on purpose-built benchmarks and surpassing the strongest competing guardrails by 6 to 12 absolute points. On cross-source evaluation, the 9B model attains 91.29% F1 with a more balanced precision--recall trade-off. Moreover, ablation experiments show that classification heads can equip a guardrail with risk detection capabilities beyond its original scope and achieve state-of-the-art performance. These results demonstrate the extensibility of the approach and its generality as a plug-in enhancement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。