arXiv:2607.02121cs.CRcs.AI2026-07

通过行为监测区分大模型拒答是因安全护栏还是自身对齐机制。

Behind the Refusal: Determining Guardrail Activation via Behavioral Monitoring

论文配图:Behind the Refusal: Determining Guardrail Activation via Behavioral Monitoring
图 1 · 摘自论文原文
  • 基于黑盒访问,通过分析HTTP、词汇和时序信号探测护栏存在。
  • 检测护栏存在准确率100%,恶意与正常交互行为差异显著(q<0.001)。
  • 可识别护栏拦截内容类别,对未知提示区分护栏拦截与模型拒绝,F1达98%。

随着大语言模型(LLMs)及智能体系统在真实场景中应用日益广泛,其安全与可靠性至关重要。防护栏系统用于检测并阻止发送至或来自大模型的恶意指令,是人工智能安全的关键组成部分。然而,在对生产环境中的AI系统进行黑盒对抗性模拟时,研究人员常难以判断模型拒绝是由于防护栏拦截还是模型自身安全对齐所致。这一区分至关重要,因为绕过防护栏与绕过模型对齐所用技术截然不同,直接影响攻击策略选择与优化。本文提出首个黑盒防护栏侦察方法,仅需黑盒访问和零先验知识,通过监控HTTP、词汇和时间信号来检测目标系统中是否存在防护栏。实验表明,该方法能以100%准确率检测到防护栏存在,且良性与恶意交互行为间具有统计显著差异(q < 0.001)。此外,该方法还能识别防护栏所针对的内容类别,并在未见提示上以平均F1分数98%区分防护栏拦截与模型拒绝。

原文摘要 · Abstract (English)

As Large Language Models (LLMs) and agentic systems become integrated into real-world applications, ensuring their safety and security is critical. Guardrail systems that detect and block malicious instructions sent to and from an LLM are an essential component of AI security. However, researchers conducting black-box adversarial emulation against production AI systems often struggle to determine whether a guardrail block or an LLM rejection has occurred. This distinction is important because the techniques used to bypass guardrails can differ substantially from those used to bypass LLM safety alignment, and has a material impact on attack technique selection and optimization. We propose the first black-box guardrail reconnaissance methodology, which detects the presence of a guardrail within a target AI system through behavioral monitoring of HTTP, lexical, and timing signals, assuming only black-box access and zero prior knowledge of the guardrail or AI system. Experiments demonstrate that our approach detects guardrail presence with 100% accuracy, with statistically significant behavioral separation between benign and malicious interactions (q < 0.001). Our approach further identifies the content categories a guardrail is designed to block, and distinguishes guardrail blocks from LLM rejection on unseen prompts with an average F1 score of 98%.

AI安全防护栏黑盒攻击行为监测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。