arXiv:2502.12520cs.CV2025-02ACL被引 31

提出安全遗忘框架,让多模态大模型有效删除有害知识而不失性能。

SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning

论文配图:SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning
图 1 · 摘自论文原文
  • 通过解耦提示设计新损失函数,缓解遗忘过程中的过度遗忘问题。
  • 在3000张图像和2.88万组VQA数据上测试,显著降低有害回答拒绝率79.5%。
  • 适合关注模型安全性、隐私保护及可控遗忘的研究者与开发者。

随着多模态大语言模型(MLLMs)的发展,其潜在安全问题日益突出。机器遗忘(MU)作为训练数据中特定知识遗忘的有效策略,广泛应用于隐私保护。然而,针对MLLM安全性的机器遗忘尚未充分探索。为此,我们提出了SAFEERASER,一个面向MLLM的安全遗忘基准,包含3,000张图像和28.8K组视觉问答对。从遗忘效果和模型能力两方面全面评估现有遗忘方法,发现其在执行遗忘时难以维持模型性能,常出现过度遗忘。因此,我们引入提示解耦(PD)损失,通过遗忘过程中解耦提示缓解过度遗忘。为量化PD损失的缓解效果,提出新的安全回答拒绝率(SARR)指标。实验表明,将PD损失与现有遗忘方法结合,可有效防止过度遗忘,使LLaVA-7B和LLaVA-13B的SARR下降79.5%,同时保持良好的遗忘质量与模型实用性。代码与数据集将在论文接受后公开。警告:本文含有害语言与图像,建议读者谨慎阅读。

原文摘要 · Abstract (English)

As Multimodal Large Language Models (MLLMs) develop, their potential security issues have become increasingly prominent. Machine Unlearning (MU), as an effective strategy for forgetting specific knowledge in training data, has been widely used in privacy protection. However, MU for safety in MLLM has yet to be fully explored. To address this issue, we propose SAFEERASER, a safety unlearning benchmark for MLLMs, consisting of 3,000 images and 28.8K VQA pairs. We comprehensively evaluate unlearning methods from two perspectives: forget quality and model utility. Our findings show that existing MU methods struggle to maintain model performance while implementing the forget operation and often suffer from over-forgetting. Hence, we introduce Prompt Decouple (PD) Loss to alleviate over-forgetting through decouple prompt during unlearning process. To quantitatively measure over-forgetting mitigated by PD Loss, we propose a new metric called Safe Answer Refusal Rate (SARR). Experimental results demonstrate that combining PD Loss with existing unlearning methods can effectively prevent over-forgetting and achieve a decrease of 79.5% in the SARR metric of LLaVA-7B and LLaVA-13B, while maintaining forget quality and model utility. Our code and dataset will be released upon acceptance. Warning: This paper contains examples of harmful language and images, and reader discretion is recommended.

多模态安全遗忘大模型提示解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。