用隐式推理提升大模型安全防护效率,速度提升12.9倍
Robust and Efficient Guardrails with Latent Reasoning

- 将多步安全推理映射到连续潜空间,推理时直接传递隐藏状态
- 在8个安全基准上相比Llama Guard 3提升8.24点宏F1,速度加快12.9倍
- 适合需要高吞吐、低延迟部署的安全过滤场景
随着大语言模型在真实应用中日益普及,其安全性维护至关重要。现有安全防护机制通常依赖单次分类或近期的简化推理。基于推理的防护显著优于仅分类的基线,但带来显著的查询延迟和令牌开销,难以用于高吞吐部署。为此,我们提出COLAGUARD,通过分阶段训练课程将多步安全推理迁移至连续潜空间,实现推理时的直接隐藏状态传播。在涵盖八个安全基准的十种提示与响应审核场景中评估,COLAGUARD相比Llama Guard 3在宏F1上提升8.24点,且在宏F1上达到与显式推理基线GuardReasoner相当水平,同时实现12.9倍加速和22.4倍令牌使用减少。结果表明,隐式推理为可部署防护提供了实用替代方案,兼顾安全鲁棒性与推理效率,而非将其视为相互冲突的目标。
原文摘要 · Abstract (English)
Maintaining the safety of large language models (LLMs) is crucial as they are increasingly deployed in real-world applications. Existing safety guardrails typically rely on single-pass classification or, more recently, distilled reasoning. Reasoning-based guardrails significantly outperform classification-only baselines, but they incur substantial query latency and token overhead that make them impractical for highthroughput deployment. To address this challenge, we propose COLAGUARD, a guardrail model that transfers multi-step safety reasoning into a continuous latent space through a stage-wise training curriculum, enabling direct hidden-state propagation at inference. Evaluated on ten prompt- and response-moderation settings spanning eight safety benchmarks, COLAGUARD improves macro-F1 by 8.24 points over Llama Guard 3 and matches our explicit reasoning baseline, GuardReasoner, in macroF1 while delivering a 12.9X speedup and 22.4X reduction in token usage. Our results suggest that latent reasoning offers a practical alternative to explicit rationale generation for deployable guardrails, jointly improving safety robustness and inference efficiency rather than treating them as competing objectives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。