arXiv:2410.16454cs.CLcs.AI2024-10ICLR被引 81

量化会恢复大模型遗忘的内容,暴露现有遗忘方法的漏洞。

Catastrophic Failure of LLM Unlearning via Quantization

  • 用量化手段检测模型是否真正遗忘知识。
  • 4比特量化后,遗忘知识恢复率达83%。
  • 适合关注模型安全与数据隐私的研究者。

大语言模型(LLMs)在海量文本上训练后表现出卓越的文本生成能力,但其训练数据可能包含版权和隐私内容,导致模型产生不良行为。机器遗忘被提出作为无需重训即可消除此类问题的方法,旨在移除特定知识的同时尽量保留模型效用。然而,现有遗忘方法是否真正实现遗忘,而非仅隐藏知识,尚缺乏有效评估。本文发现,对已遗忘的模型进行量化操作可恢复被“遗忘”的信息。我们通过多种量化技术在不同精度下进行系统实验,结果表明:在有性能约束的遗忘方法中,全精度模型仍保留平均21%的应遗忘知识,经4比特量化后该比例飙升至83%。代码已公开于https://github.com/zzwjames/FailureLLMUnlearning。

原文摘要 · Abstract (English)

Large language models (LLMs) have shown remarkable proficiency in generating text, benefiting from extensive training on vast textual corpora. However, LLMs may also acquire unwanted behaviors from the diverse and sensitive nature of their training data, which can include copyrighted and private content. Machine unlearning has been introduced as a viable solution to remove the influence of such problematic content without the need for costly and time-consuming retraining. This process aims to erase specific knowledge from LLMs while preserving as much model utility as possible. Despite the effectiveness of current unlearning methods, little attention has been given to whether existing unlearning methods for LLMs truly achieve forgetting or merely hide the knowledge, which current unlearning benchmarks fail to detect. This paper reveals that applying quantization to models that have undergone unlearning can restore the "forgotten" information. To thoroughly evaluate this phenomenon, we conduct comprehensive experiments using various quantization techniques across multiple precision levels. We find that for unlearning methods with utility constraints, the unlearned model retains an average of 21\% of the intended forgotten knowledge in full precision, which significantly increases to 83\% after 4-bit quantization. ... Our code is available at: \href{https://github.com/zzwjames/FailureLLMUnlearning}{https://github.com/zzwjames/FailureLLMUnlearning}.

大模型遗忘量化安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。