arXiv:2607.08173cs.AI2026-07中稿 · ICML

通过放大推理权重,让模型更主动暴露隐藏信息。

Overthinking: Amplifying Reasoning Weights to Extract Learned Secrets

论文配图:Overthinking: Amplifying Reasoning Weights to Extract Learned Secrets
图 1 · 摘自论文原文
  • 用推理向量放大非推理模型的思考倾向,生成新模型。
  • 在2B-32B模型上,秘密暴露频率提升至原模型10倍。
  • 适合检测模型训练中隐藏的偏见或敏感行为。

语言模型的黑盒审计是部署前的关键工具,但可能遗漏细微的对齐问题和隐藏信息。为更好揭示审计过程中的隐含信息,我们提出「过度思考」:利用推理任务向量放大推理模型的外显思考倾向。给定非推理指令模型 $M$ 与推理蒸馏模型 $R$ 的参数,定义「过度思考模型」为 $oldsymbolθ_{/mathcal{O}_α} = oldsymbolθ_{/mathcal{M}} + α(oldsymbolθ_{/mathcal{R}} - oldsymbolθ_{/mathcal{M}})$,其中 $α>1$ 将推理能力放大至超过纯推理模型 $R$。此外,引入新的逐层衰减策略,选择性增强推理能力而不牺牲输出质量与连贯性。实验表明,在四个设置下,过度思考模型更易揭示隐藏信息,覆盖2B-32B规模模型。结果表明,推理放大可使训练中习得的秘密或意外行为暴露频率提升至原始推理模型的10倍。秘密暴露方式取决于秘密类型:部分需沿推理方向扰动,另一些则只需足够大的权重扰动即可触发。

原文摘要 · Abstract (English)

Black box auditing of language models is an essential pre-deployment tool, but it may miss subtle forms of misalignment and hidden information. To better elicit hidden information during an auditing process, we introduce \emph{overthinking}: the process of using reasoning task vectors to amplify the propensity to think out loud of reasoning models. Given the parameters of a non-reasoning instruct model $M$ and reasoning-distilled model $R$, we define the \emph{overthinking model} as $\boldsymbolθ_{\mathcal{O}_α} = \boldsymbolθ_{\mathcal{M}} + α(\boldsymbolθ_{\mathcal{R}} - \boldsymbolθ_{\mathcal{M}})$, where $α> 1$ amplifies reasoning beyond the pure reasoning model $R$. Additionally, we introduce new layer-wise attenuation strategies that selectively amplify reasoning without losing quality and coherence of model outputs. We demonstrate that overthinking models are more likely to reveal hidden information across four experimental settings, across 2B-32B models. Our findings suggest that reasoning amplification may surface secrets or unintended behaviors acquired during training up to $10\times$ more frequently than the original reasoning model. How secrets surface depends on the secret type: some require perturbation along the reasoning direction, while others yield to any sufficiently large weight perturbation.

模型审计推理放大隐藏信息黑盒检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。