arXiv:2605.05678cs.AI2026-05被引 1

发现大模型推理过程有隐藏安全风险,提出动态修正方法。

Chain of Risk: Safety Failures in Large Reasoning Models and Mitigation via Adaptive Multi-Principle Steering

论文配图:Chain of Risk: Safety Failures in Large Reasoning Models and Mitigation via Adaptive Multi-Principle Steering
图 1 · 摘自论文原文
  • 在推理链中检测到比最终答案更严重的安全隐患
  • 高危案例中41%的错误源于推理过程暴露
  • 新方法可降低40.8%的不安全输出,保持97.7%准确率

大型推理模型(LRMs)为提升透明度和可验证性,逐渐暴露其思维链。但这带来安全盲区:即使最终回答看似安全,推理过程仍可能包含违规内容。我们通过统一的二十项安全准则,评估15个开源与API模型在41,000个提示下的推理链与最终答案。结果显示,推理阶段普遍存在额外风险,尤其在“泄漏”(不当推理后得安全答案)和“逃逸”(良性推理后出危险答案)两类高危情形中。分析表明风险集中于虚假信息、法律合规、歧视、身体伤害和心理伤害等原则。为此提出自适应多原则调优方法:基于白盒测试时学习每项原则的不安全到安全方向,并仅激活当前状态更接近不安全中心的方向。在三个可调模型上,该方法显著降低推理链与最终答案的不安全输出,在持保留和分布外数据集上均有效。DeepSeek-R1-Qwen-7B实现平均40.8%的不安全计数下降,同时保持在BBH、GSM8K和MMLU上的97.7%宏观平均准确率。结果表明,模型安全应贯穿完整推理轨迹而非仅关注最终输出。

原文摘要 · Abstract (English)

Large reasoning models (LRMs) increasingly expose chain-of-thought-like reasoning for transparency, verification, and deliberate problem solving. This creates a safety blind spot: harmful or policy-violating content may appear in reasoning traces even when final answers appear safe. We test whether final-answer safety is a sufficient proxy for the full reasoning-answer trajectory by scoring both stages under a unified twenty-principle safety rubric. Using prompts from seven public harmfulness and jailbreak sources, plus four out-of-distribution (OOD) sources, we evaluate 15 open-weight and API-based LRMs across 41K prompts per model. Reasoning traces consistently reveal additional safety risks beyond final answers, especially in high-severity stage-wise failures: leak cases, where unsafe reasoning precedes a safe-looking answer, and escape cases, where benign-looking reasoning precedes an unsafe final response. Principle-level analysis shows that risk concentrates in misinformation, legal compliance, discrimination, physical harm, and psychological harm. We further propose adaptive multi-principle steering, a white-box test-time mitigation that learns one unsafe-to-safe activation direction per safety principle and activates only directions whose current hidden state is closer to the unsafe than safe centroid. On three steerable open reasoning models, adaptive steering reduces unsafe counts in both reasoning traces and final answers on held-out and OOD benchmarks. DeepSeek-R1-Qwen-7B achieves a 40.8% average unsafe-count reduction while retaining 97.7% macro-averaged accuracy on BBH, GSM8K, and MMLU. These results suggest that LRM safety should be evaluated and mitigated over the full exposed reasoning-answer trajectory, not only at the final-answer stage.

模型安全推理链风险检测自适应调优

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。