arXiv:2607.28196cs.CL2026-07

压缩模型通过所有质量检测却会虚构操作步骤,需新增安全筛查

Fidelity Is Not Safety: Gently-Compressed LLMs Pass Every Data-Free Quality Guard Yet Invent Procedure Steps in Agentic Execution

  • 用低秩压缩诱导模型虚构指令外的执行步骤
  • 仅低秩压缩会出错,同困惑度下剪枝则无此问题
  • 提出双轴指标可跨架构识别潜在风险模型

实践者通常在压缩语言模型后,通过一系列低成本质量检测:困惑度接近原始模型、下游任务准确率(如MMLU)在置信区间内、以及基于随机输入的内部表示相似性数据自由输出保真度信号。然而这一套检测存在盲点。在三种模型族中,经过温和压缩的模型均通过所有检测,但在作为代理执行标准操作流程时却虚构了从未在指令中出现的操作步骤。该现象具有算子特异性:一致的低秩(SVD)截断会引发此问题,而匹配相同困惑度的幅度剪枝则不会。一项分离实验表明,同一压缩权重在保真度测试中表现良好,却在虚构步骤探测中失败。根本原因在于压缩误差的相干性与其速率的乘积,而非误差大小。数据自由保真度探针本身是保真度预言机,无法察觉这一维度。我们通过预注册、高统计功效的探测任务,在三种架构上量化了这一盲点与分离现象。算子特异性在三类模型中重复出现,且困惑度规避现象出现在模型保留低秩冗余的空间中。随后提出一种数据自由筛选方法:基于压缩误差的相干分数与错误率的双轴统计量,使用固定阈值即可跨架构识别风险模型。困惑度、MMLU与保真度通过不能保证代理安全性。应在代理部署前筛查低秩压缩版本。

原文摘要 · Abstract (English)

Practitioners accept a compressed language model once it clears a stack of data-cheap quality guards: perplexity within a small factor of the original, downstream accuracy (for example MMLU) inside a confidence interval, and data-free output-fidelity signals that compare the compressed and original network's internal representations under random probe inputs. This stack has a blind spot. Across three model families, gently-compressed models clear every guard and then invent procedure steps that were never in the instructions when they run a standard operating procedure (SOP) as an agent. The effect is operator-specific: coherent low-rank (SVD) truncation induces it, and magnitude pruning matched to the same perplexity does not. One dissociation isolates the cause. The same compressed weights that CI-win a paired output-fidelity test CI-fail the invented-step canary. The governing axis is the coherence of the compression error times its rate; the magnitude of the damage does not predict it. The data-free fidelity probe is a fidelity oracle by construction, so it cannot see this axis. We characterize the blindspot and dissociation with paired confidence intervals on a pre-registered, powered canary across three architectures. Operator-specificity replicates on all three, and the perplexity-guard evasion appears where the model admits in-guard low-rank headroom. We then give a data-free screen: a two-axis statistic of the compression error (coherent-fraction and error-rate) that flags the failing builds with fixed thresholds across architectures and matches the coherence-times-rate mechanism. Perplexity, MMLU, and fidelity acceptance do not certify agent safety. Screen gently-compressed low-rank builds before agentic deployment

大模型压缩代理安全模型幻觉数据自由检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。