arXiv:2510.19169cs.CRcs.CL2025-10被引 4

开源平台统一防护大模型安全风险,支持多语言实时拦截有害内容与攻击。

OpenGuardrails: A Configurable, Unified, and Scalable Guardrails Platform for Large Language Models

  • 用可配置策略动态调整安全阈值,支持按请求定制检测规则。
  • 单模型同时检测内容安全与攻击行为,准确率超98%且模型压缩至3.3B。
  • 适合企业部署为安全网关,全开源支持119种语言,可直接用于生产环境。

随着大语言模型在真实应用中日益普及,保障其安全性、鲁棒性及隐私合规性变得至关重要。我们提出OpenGuardrails,首个完全开源的统一平台,集成大模型驱动的安全检测、对抗操纵防御与可部署的护栏基础设施。该平台抵御三类主要风险:(1) 内容安全违规,如生成有害或露骨文本;(2) 模型操纵攻击,包括提示注入、越狱和代码解释器滥用;(3) 数据泄露,涉及敏感或私密信息。不同于以往模块化或基于规则的框架,OpenGuardrails引入三项核心创新:(1) 可配置策略适配机制,支持按请求自定义不安全类别与敏感度阈值;(2) 统一的大模型护栏架构,通过单一模型完成内容安全与操纵检测;(3) 量化可扩展模型设计,将140亿参数密集模型通过GPTQ压缩至33亿参数,同时保持基准测试准确率超过98%。系统支持119种语言,在多语言安全基准上达到顶尖性能,可作为安全网关或API服务部署于企业场景。所有模型、数据集与部署脚本均以Apache 2.0许可发布。

原文摘要 · Abstract (English)

As large language models (LLMs) are increasingly integrated into real-world applications, ensuring their safety, robustness, and privacy compliance has become critical. We present OpenGuardrails, the first fully open-source platform that unifies large-model-based safety detection, manipulation defense, and deployable guardrail infrastructure. OpenGuardrails protects against three major classes of risks: (1) content-safety violations such as harmful or explicit text generation, (2) model-manipulation attacks including prompt injection, jailbreaks, and code-interpreter abuse, and (3) data leakage involving sensitive or private information. Unlike prior modular or rule-based frameworks, OpenGuardrails introduces three core innovations: (1) a Configurable Policy Adaptation mechanism that allows per-request customization of unsafe categories and sensitivity thresholds; (2) a Unified LLM-based Guard Architecture that performs both content-safety and manipulation detection within a single model; and (3) a Quantized, Scalable Model Design that compresses a 14B dense base model to 3.3B via GPTQ while preserving over 98 of benchmark accuracy. The system supports 119 languages, achieves state-of-the-art performance across multilingual safety benchmarks, and can be deployed as a secure gateway or API-based service for enterprise use. All models, datasets, and deployment scripts are released under the Apache 2.0 license.

大模型安全护栏机制开源平台多语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。