arXiv:2605.01699cs.LGcs.AI2026-05

提出新方法彻底消除大模型中的记忆痕迹,且不影响模型能力。

Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance

论文配图:Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance
图 1 · 摘自论文原文
  • 用交叉序列探针识别记忆痕迹并定位其分布
  • 通过几何对齐手术移除痕迹,使探测分数低于随机水平
  • 在不损失模型性能前提下实现安全去记忆,适合隐私保护场景

近期攻击表明,大语言模型的行为遗忘仍会留下可被对抗探针恢复的内部痕迹。我们分析了这些痕迹的存储位置,并证明其可被精准清除而不会造成可观测的能力损失。核心方法是留一法交叉序列探针,检验记忆信号是否在保留序列间泛化。该信号真实存在且跨规模一致:Pythia-70M、GPT-2 medium 和 Mistral-7B 的记忆特异性差距分别为 +0.32、+0.19、+0.30;在 Pythia-70M 中,随机初始化对照组在深层降至 -0.04,与预训练峰值一致。探针方向可与回忆功能解耦——将其投影移除后,局部信号从 +0.44 降至 -0.19,而行为回忆几乎不变;且自然记忆训练的探针无法分类微调注入的秘密,揭示两种表征独立的模式。随后引入探针几何对齐(PGA),在每一层沿探针读出方向对齐激活值。PGA 在四个规模上均使交叉序列探针分数低于随机水平(玩具模型深度4: 0.17;Pythia-70M: 0.07;Mistral-7B: 0.45;GPT-2 medium: 0.06 via MD-PGA k=2),并抵御六种对抗探针变体。针对重新拟合攻击者,扩展 PGA 可在所有相关深度击败重拟合探针,同时保持五个零样本任务性能变化不超过 2.8 个百分点(平均 Δacc = +0.2pp)。跨序列记忆信号是预训练表示中真实、因果可分、具特定模式的属性,可通过每层单秩干预完全移除至随机以下,且无明显能力损耗。

原文摘要 · Abstract (English)

Recent attacks show that behavioural unlearning of large language models leaves internal traces recoverable by adversarial probes. We characterise where this retention lives and show it can be surgically removed without measurable capability cost. Our central protocol is a leave-one-out cross-sequence probe that tests whether a memorisation signature generalises across held-out sequences. The signature is real and consistent across scale: memorisation-specific gaps of +0.32, +0.19, +0.30 on Pythia-70M, GPT-2 medium, and Mistral-7B; on Pythia-70M, the random-initialisation control collapses to -0.04 at the deepest layer where the pretrained signature peaks. The probe direction is causally separable from recall -- projecting it out collapses the signature locally (+0.44 -> -0.19) while behavioural recall barely changes -- and a probe trained on naturally memorised content does not classify fine-tuning-injected secrets, marking two representationally distinct regimes. We then introduce probe-geometry alignment (PGA), a surgical erasure that aligns activations along the probe's live readout direction at each depth. PGA drives the cross-sequence probe below random chance at all four scales tested (toy depth-4: 0.17; Pythia-70M: 0.07; Mistral-7B: 0.45; GPT-2 medium: 0.06 via MD-PGA k=2) and remains robust to six adversarial probe variants. Against a re-fitting attacker who trains a fresh probe on PGA-treated activations, we extend PGA adversarially, defeating the re-fit probe at every memorisation-relevant depth while preserving five zero-shot capability benchmarks within 2.8 percentage points per task (mean Δacc = +0.2pp). The cross-sequence signature is a real, causally separable, regime-specific property of pretrained representations -- removable below chance with a single rank-one intervention per depth at no measurable capability cost.

模型记忆隐私保护去记忆探针分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。