arXiv:2605.18838cs.LGcs.AI2026-05被引 1

模型越大越说真话,但关键转折点因架构和训练方式而异。

Lying Is Just a Phase: The Hidden Alignment Transition in Language Model Scaling

论文配图:Lying Is Just a Phase: The Hidden Alignment Transition in Language Model Scaling
图 1 · 摘自论文原文
  • 通过测量推理与真实性的耦合关系,发现模型存在从对立到协作的隐性转变。
  • 参数量达35亿时出现转折,但数据和架构可提前或推迟这一临界点。
  • 无需修改模型权重,仅靠添加一个向量就能纠正60%的说谎输出。

我们测量了63个基础模型(来自16个模型家族)在推理与真实性之间的耦合关系,发现当模型规模低于家族依赖的临界值N_c(约35亿参数,95%置信区间[29亿, 134亿])时,二者呈强烈负相关(r = -0.989,p = 4×10⁻⁵,非参数置换检验);超过该阈值后则转为正相关。模型规模并非唯一决定因素:数据清洗可消除通义千问生成中的耦合下降(0.025→0.830),Gemma-4在40亿参数下实现0.871的耦合度(相当于标准训练的130亿以上模型),通过蒸馏与架构创新达成;Phi在10亿参数下通过数据清洗达到100亿参数网络的真实度水平。宽度归一化消除所有家族中的负相关,支持输出投影瓶颈假说。40个模型中38个显示无竞争注意力头。稀疏回归微分方程对未见的Llama-2预测误差仅5.6%。诊断仅需公开基准分数,不依赖内部结构。前沿模型仍呈现合作趋势(r = +0.72,34个模型,10个实验室)。概念验证干预表明,仅在特定层添加一个真理方向向量,即可在不重训的情况下修正60%错误输出,实现按推理校正。代码、数据、开源控制台工具及交互式诊断仪表盘已发布:https://zehenlabs.com/cape/。

原文摘要 · Abstract (English)

Scaling laws predict loss from compute but not how capabilities interact. We measure the coupling between reasoning and truthfulness across 63 base models from 16 families and find a regime change invisible to loss curves: below a family-dependent critical scale N_c, capabilities anticorrelate (r = -0.989, p = 4 x 10^{-5} nonparametric permutation test); above it, they cooperate. N_c ~ 3.5B parameters [2.9B, 13.4B] (bootstrap 95% CI), but model size is not the only variable that determines phase. Architecture, data curation, and training recipe each shift N_c independently: curated training eliminated the coupling dip between Qwen generations (0.025 to 0.830 at matched scale), Gemma-4 at 4B achieves coupling 0.871, characteristic of 13B+ standard-trained models, through distillation and architectural innovation, and Phi at 1B matches web-trained coupling at 10B through data curation alone. Width normalization eliminates the anticorrelation across all tested families, supporting an output-projection bottleneck. Internally, 38 of 40 models show zero competing attention heads. A sparse-regression ODE cross-predicts held-out Llama-2 at 5.6% error. The diagnostic requires no model internals -- only public benchmark scores across a model family. The cooperative regime extends to the frontier (r = +0.72, 34 models, 10 labs). A proof-of-concept intervention confirms the bottleneck is exploitable: adding a single truth-direction vector at the identified layer corrects 60% of misaligned outputs in the tax phase with zero retraining -- a surgical, per-inference correction that requires no weight modification. Code, data, an open-source steering CLI for any open-weight model, and an interactive dashboard for phase diagnosis are released: https://zehenlabs.com/cape/.

模型对齐规模定律真相性可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。