用稀疏自编码器引导投影,实现可解释且抗攻击的模型删忆。
Model Unlearning via Sparse Autoencoder Subspace Guided Projections
- 通过SAE特征构建目标子空间,指导参数更新方向。
- 在WMDP-Cyber数据集上使有害知识准确率降低3.22%。
- 适合需要可控、安全删忆的高阶模型应用者。
大语言模型存储海量信息,虽强大却面临隐私与安全挑战,尤其在需选择性删除知识时。现有删忆方法如基于梯度的微调、模型编辑或稀疏自编码器(SAE)调控,或缺乏可解释性,或无法抵御对抗性提示。本文提出SAE引导子空间投影删忆(SSPU),利用SAE特征驱动模型参数空间中的精准更新,实现可解释且鲁棒的删忆。SSPU包含三阶段:数据驱动地选择层与特征,通过QR分解构建子空间,再进行约束优化,将激活投影至“无关”子空间同时保留所需知识。整体通过构造监督删忆的子空间,优化损失并加入正则项以指导可解释的参数更新。在WMDP-Cyber遗忘数据集及三个通用能力基准(MMLU、TruthfulQA、GSM8K)上的实验表明,相比最强基线,SSPU将有害知识准确率降低3.22%,并提升对抗攻击下的鲁棒性,降低越狱提示下的恶意准确率。研究揭示了现有删忆方法的局限,并展示可解释子空间引导优化在实现可控、鲁棒模型行为上的潜力。
原文摘要 · Abstract (English)
Large language models (LLMs) store vast amounts of information, making them powerful yet raising privacy and safety concerns when selective knowledge removal is required. Existing unlearning strategies, ranging from gradient-based fine-tuning and model editing to sparse autoencoder (SAE) steering, either lack interpretability or fail to provide a robust defense against adversarial prompts. We propose SAE-Guided Subspace Projection Unlearning (SSPU), a novel framework that leverages SAE features to drive targeted updates in the model's parameter space, enabling precise, interpretable, and robust unlearning. SSPU's three-stage pipeline performs data-driven layer and feature selection, subspace construction via QR decomposition, and constrained optimization that controls activations into an "irrelevant" subspace while preserving retained knowledge. Overall, we use SAE features to construct a subspace that supervises unlearning, refining the loss and adding a regularization term to guide interpretable parameter updates. In experiments on the WMDP-Cyber forget set and three utility benchmarks (MMLU, TruthfulQA, GSM8K), SSPU reduces harmful knowledge accuracy by 3.22% compared to the strongest baseline. It also improves adversarial robustness, lowering malicious accuracy under jailbreak prompts compared to baselines. Our findings expose the limitations of prior unlearning methods and demonstrate how interpretable subspace-guided optimization can achieve robust, controllable model behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。