arXiv:2602.06650cs.CL2026-02

让大模型按风险动态调整安全策略,更好平衡安全与有用性。

Beyond Static Alignment: Hierarchical Policy Control for LLM Safety via Risk-Aware Chain-of-Thought

  • 分层策略架构:全局不可变安全边界 + 用户自定义风险规则
  • 在标准测试中接近顶尖安全表现,用户定制场景下可控性最优
  • 透明化决策路径,适合需要灵活安全控制的应用场景

大型语言模型因采用静态、统一的安全策略,缺乏运行时可调控性,难以适应多样应用需求,导致对无害请求过度拒绝或对有害请求约束不足。我们提出PACT(基于思维链的提示配置行为),通过显式、风险感知的推理实现动态安全控制。PACT采用分层策略架构:不可覆盖的全局安全策略设定关键风险(如儿童安全、暴力极端主义)的绝对边界,用户可自定义领域特定风险类别并指定标签到行为的映射,以提升实际部署中的实用性。该框架将安全决策分解为结构化的‘分类→执行’路径,将请求路由至合规、引导或拒绝动作,并使决策过程透明。大量实验表明,PACT在全局策略评估中达到接近当前最佳的安全性能,在用户自定义策略评估中展现出最优可控性,有效缓解安全与有用性的权衡。我们将公开PACT模型套件、训练数据和评估协议,推动可复现的可控安全对齐研究。

原文摘要 · Abstract (English)

Large Language Models (LLMs) face a fundamental safety-helpfulness trade-off due to static, one-size-fits-all safety policies that lack runtime controllabilityxf, making it difficult to tailor responses to diverse application needs. %As a result, models may over-refuse benign requests or under-constrain harmful ones. We present \textbf{PACT} (Prompt-configured Action via Chain-of-Thought), a framework for dynamic safety control through explicit, risk-aware reasoning. PACT operates under a hierarchical policy architecture: a non-overridable global safety policy establishes immutable boundaries for critical risks (e.g., child safety, violent extremism), while user-defined policies can introduce domain-specific (non-global) risk categories and specify label-to-action behaviors to improve utility in real-world deployment settings. The framework decomposes safety decisions into structured Classify$\rightarrow$Act paths that route queries to the appropriate action (comply, guide, or reject) and render the decision-making process transparent. Extensive experiments demonstrate that PACT achieves near state-of-the-art safety performance under global policy evaluation while attaining the best controllability under user-specific policy evaluation, effectively mitigating the safety-helpfulness trade-off. We will release the PACT model suite, training data, and evaluation protocols to facilitate reproducible research in controllable safety alignment.

大模型安全可控生成风险感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。