arXiv:2601.22030cs.LG2026-01被引 1

针对大模型删减隐私信息时过度遗忘的问题,提出按参数精细调节的解法。

Per-parameter Task Arithmetic for Unlearning in Large Language Models

  • 按每个参数重要性动态调整删除向量,避免全盘破坏
  • 在多个数据集上比传统方法更少遗忘有用信息,性能更优
  • 适合需要高效且安全移除敏感信息的研究与应用

大型语言模型(LLM)在去个性化时需移除隐私信息。任务算术通过减去特定任务向量(TV)实现,即私有信息微调模型与原始模型的参数差。该方法虽高效,但可能因干扰关键参数导致过度遗忘。我们观察到各参数对遗忘与保留的重要性不同,因此提出逐参数任务算术(PerTA),对任务向量进行逐参数缩放。权重通过梯度(PerTA-grad)或对角Fisher信息近似(PerTA-fisher)估计,量化参数在遗忘与保留中的相对重要性。我们分析了其有效性,拓展为通用形式并提供深入讨论。大量实验表明,PerTA在多数情况下优于标准任务向量,且在遗忘效果和模型整体性能上超越常用训练型去个性化方法。在保持任务算术高效性的同时缓解过度遗忘,为大模型去个性化提供了原则性强、实用的框架。

原文摘要 · Abstract (English)

In large language model (LLM) unlearning, private information is required to be removed. Task arithmetic unlearns by subtracting a specific task vector (TV)--defined as the parameter difference between a privacy-information-tuned model and the original model. While efficient, it can cause over-forgetting by disrupting parameters essential for retaining other information. Motivated by the observation that each parameter exhibits different importance for forgetting versus retention, we propose a per-parameter task arithmetic (PerTA) mechanism to rescale the TV, allowing per-parameter adjustment. These weights quantify the relative importance of each parameter for forgetting versus retention, estimated via gradients (i.e., PerTA-grad) or the diagonal Fisher information approximation (i.e., PerTA-fisher). Moreover, we discuss the effectiveness of PerTA, extend it to a more general form, and provide further analysis. Extensive experiments demonstrate that PerTA consistently improves upon standard TV, and in many cases surpasses widely used training-based unlearning methods in both forgetting effectiveness and overall model utility. By retaining the efficiency of task arithmetic while mitigating over-forgetting, PerTA offers a principled and practical framework for LLM unlearning.

大模型去个性化任务算术隐私保护参数调控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。