arXiv:2601.19768cs.AIcs.CR2026-01中稿 · ICLR被引 2

用规则监控激活值,让AI安全防护更精准可查。

GAVEL: Towards Rule-Based Safety Through Activation Monitoring

  • 将神经元激活拆解为可解释的语义单元,组合成行为规则。
  • 实测精度显著提升,支持动态调整规则而无需重训练。
  • 适合需要透明审计的AI安全场景,如金融或医疗领域。

大型语言模型日益依赖基于激活值的监测来识别表面文本难以察觉的有害行为。然而,现有方法在广泛滥用数据集上训练,存在精度差、灵活性低、可解释性弱的问题。本文提出一种新范式:基于规则的激活安全,借鉴网络安全中的规则共享实践。我们把激活值建模为认知元素(CEs),即细粒度、可解释的语义因子,如‘发出威胁’和‘支付处理’,可通过组合捕捉特定领域的复杂行为,实现更高精度。基于此,我们构建了一个实用框架,定义在CEs上的谓词规则并实时检测违规行为。该框架允许从业者无需重训练模型或检测器即可配置和更新安全策略,同时保障透明性与可审计性。实验表明,这种组合式规则驱动的安全机制提升了精度,支持领域定制,并为可扩展、可解释、可审计的AI治理奠定基础。我们开源了GAVEL,并推出GAVEL Studio——一个交互式规则编写与管理工具。代码与数据集见github.com/Offensive-AI-Lab/gavel。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly paired with activation-based monitoring to detect and prevent harmful behaviors that may not be apparent at the surface-text level. However, existing activation safety approaches, trained on broad misuse datasets, struggle with poor precision, limited flexibility, and lack of interpretability. This paper introduces a new paradigm: rule-based activation safety, inspired by rule-sharing practices in cybersecurity. We propose modeling activations as cognitive elements (CEs), fine-grained, interpretable factors such as 'making a threat' and 'payment processing', that can be composed to capture nuanced, domain-specific behaviors with higher precision. Building on this representation, we present a practical framework that defines predicate rules over CEs and detects violations in real time. This enables practitioners to configure and update safeguards without retraining models or detectors, while supporting transparency and auditability. Our results show that compositional rule-based activation safety improves precision, supports domain customization, and lays the groundwork for scalable, interpretable, and auditable AI governance. We open source GAVEL and introduce GAVEL Studio, an interactive rule authoring and management tool. Code and datasets are available at github.com/Offensive-AI-Lab/gavel.

AI安全规则系统可解释性激活监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。