arXiv:2607.04640cs.CL2026-07被引 1

发现大模型先错后纠正,影响压缩与评估可靠性

Wrong Before Right: Late Rescue and Interface Failure in Aligned Language Models

论文配图:Wrong Before Right: Late Rescue and Interface Failure in Aligned Language Models
图 1 · 摘自论文原文
  • 通过层间差异分析,发现中层临时选错答案,后期才修正
  • 错误峰值在32B模型达9.7倍显著性,压缩失败率高3-7倍
  • 训练时惩罚中期错误可降错67%,提升模型鲁棒性

我们研究对齐语言模型内部正确性如何构建,而不仅是最终答案是否正确。基于极性控制的最小对比对,采用逐层差分法分析,发现中层(25%-90%深度)存在短暂错误倾向,即‘错误下潜’现象,仅由深层修正。通过跨17个模型、三类架构、64倍规模(0.5B-32B)的激活移植验证其因果性。四项发现:(1) 错误下潜受训练配方影响,呈涌现特性:Qwen2.5在3B时出现,32B时峰值显著(配对t=9.7),Llama-3-8B反向下降(t=-2.31),Mistral-7B居中;(2) 该下潜预测真实压缩失败:高下潜项在低秩压缩、块删除或结构剪枝下翻转概率高3-7倍,量化翻转则无关联,双重解离经深层消融证实;(3) 可训练调控:引入中层错误惩罚的LoRA微调,达到输出级SFT准确率,同时降低因果错误下潜67%-70%,而纯输出级SFT反而使错误下潜恶化2.8倍;(4) 控制读出后,该现象仍存在于自然语言输入:结构损伤失败呈现显著下潜分层,自由形式脆弱性分为可被下潜检测的晚期救赎层与不可检测的接口层。表明表面正确可能掩盖晚期救援机制,影响压缩风险、后训练质量与评估偏差。

原文摘要 · Abstract (English)

We study how correctness is assembled inside aligned language models, not only whether the final answer is right. Using layer-wise difference-in-differences (DiD) trajectories over polarity-controlled minimal pairs, we identify the wrong-dip: in mid layers (25-90% depth), internal preference transiently commits to the incorrect answer and is rescued only by late-layer correction. We verify this causally with patchscope-style activation transplantation across 17 models, three families, and 64x scale (0.5B-32B). Four findings follow. (1) Alignment amplification of the causal wrong-dip is recipe-specific and emergent: it emerges at 3B in Qwen2.5, remains high, and peaks at 32B (paired t up to 9.7), reverses in Llama-3-8B (t=-2.31), and sits between for Mistral-7B. (2) The dip predicts real compression failures: high-dip items are 3-7x more likely to flip under late-layer low-rank compression, block dropping, or structured pruning, while quantization flips are dip-blind, a double dissociation confirmed by late-layer ablation. (3) The dip is trainable: a LoRA fine-tune with a mid-layer wrong-margin penalty matches output-only SFT accuracy while cutting the causal dip by 67-70% and improving compression robustness; output-only SFT worsens the causal dip by up to 2.8x at perfect surface accuracy. (4) With controlled readouts, the phenomenon survives natural-language I/O: dip stratification of structural-damage failures is significant on naturalistic vignettes, and free-form fragility separates into a dip-auditable late-rescue layer and a dip-blind interface layer. Together, output-level correctness can hide a late-rescue process that governs compression risk, post-training quality, and evaluation distortion.

大模型机制错误纠正模型压缩对齐研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。