arXiv:2606.15980cs.LGcs.AI2026-06被引 1

激活监测器在模型更新后是否仍有效?研究发现微调会使其失效,但可预测并低成本修复。

Do Activation Monitors Survive Model Updates? Benchmarking, Predicting, and Repairing Activation-Monitor Staleness

论文配图:Do Activation Monitors Survive Model Updates? Benchmarking, Predicting, and Repairing Activation-Monitor Staleness
图 1 · 摘自论文原文
  • 测试了多种模型更新对轻量级激活监测器的影响
  • 微调类更新使监测器性能大幅下降,量化则影响较小
  • 提出可预测失效并实现无需标注的修复方法

激活监测器是部署安全栈中日益常见的轻量级探针,依赖语言模型内部表示进行判断。然而部署模型常经历量化、微调、LoRA适配或合并适配器等更新,而监测器通常保持冻结。本文首次系统评估该隐含约定是否成立:基础模型训练的监测器在常规更新后是否仍可靠。结果表明,量化类更新基本保持监测器性能,而微调类更新频繁导致监测器失效。脆弱性高度依赖监测器类型,隐私/敏感信息探测器最易受影响,拒绝-合规类监测器相对稳定,说明行为重训不必然导致监测器过时。尽管NF4量化本身影响小,但QLoRA结合量化显著增加风险。我们进一步发现,失效可通过部署前特征预测,实现优先级评估与资源优化。最后测试修复策略,发现无需标签的激活重对齐可修复所有可修复的失效单元,无需校准、少样本头或重新训练。结论建议:微调应默认触发监测器重验证,利用预测机制优先检查高风险项,并以无标签重对齐作为默认修复方案。

原文摘要 · Abstract (English)

Activation monitors -- lightweight probes trained on a language model's internal representations -- are an increasingly common layer in deployment safety stacks. Deployed models however are rarely static: they are quantized, fine-tuned, adapted with LoRA, or served with merged adapters while the monitor remains frozen. We present the first systematic test of whether this implicit contract holds: whether activation monitors trained on a base model remain reliable after these routine model updates. Across multiple safety-relevant monitors, model depths, update families, and open-weight models, we find a sharp split: quantization-style updates largely preserve frozen probe performance, while fine-tuning-style updates frequently make probes stale. Fragility is highly monitor-dependent, with privacy/PII probes most affected and refusal-compliance probes comparatively stable, showing that retraining a behavior need not stale its corresponding monitor. QLoRA is especially damaging despite NF4 quantization alone being relatively benign, suggesting that quantization becomes riskier when combined with adaptation. We further show that degradation is predictable from pre-deployment features, enabling revalidation budgets to be triaged toward the monitors most likely to fail. Finally, we test repair strategies and find that cheap label-free activation realignment repairs every repair-relevant stale cell, with none requiring score calibration, few-label heads, or labeled retraining. These results suggest that fine-tuning should trigger activation-monitor revalidation by default, with prediction triaging which monitors to check first and label-free realignment as the default repair.

模型安全激活监测微调无监督修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。