arXiv:2508.10065cs.CRcs.CV2025-08ICCV被引 2

用双层水印设计让模型精准删除数据,不伤其他性能。

Invisible Watermarks, Visible Gains: Steering Machine Unlearning with Bi-Level Watermarking Design

  • 通过双层优化水印框架,让数据修改更利于模型删减。
  • 在图像分类与生成任务中,删数据效果优于现有方法。
  • 适合需要合规删除敏感数据的场景,如医疗或金融。

随着“被遗忘权”需求增加,机器遗忘(MU)成为提升信任与合规的重要工具,可移除模型中的敏感数据影响。然而现有方法多依赖训练中调整权重,较少探索数据层面修改对遗忘过程的助力。为此,本文提出一种新方法,利用数字水印策略主动修改数据内容以促进遗忘。通过引入水印,建立可控的遗忘机制,实现对特定数据的精确清除,同时保持模型在无关任务上的性能。实验发现,水印数据仍能有效支持遗忘;基于此,提出名为Water4MU的友好遗忘水印框架,其核心为双层优化(BLO):上层优化水印网络以降低遗忘难度,下层独立训练模型。结果表明,Water4MU在图像分类与生成任务中均有效,尤其在“挑战性遗忘”场景下显著优于现有方法。

原文摘要 · Abstract (English)

With the increasing demand for the right to be forgotten, machine unlearning (MU) has emerged as a vital tool for enhancing trust and regulatory compliance by enabling the removal of sensitive data influences from machine learning (ML) models. However, most MU algorithms primarily rely on in-training methods to adjust model weights, with limited exploration of the benefits that data-level adjustments could bring to the unlearning process. To address this gap, we propose a novel approach that leverages digital watermarking to facilitate MU by strategically modifying data content. By integrating watermarking, we establish a controlled unlearning mechanism that enables precise removal of specified data while maintaining model utility for unrelated tasks. We first examine the impact of watermarked data on MU, finding that MU effectively generalizes to watermarked data. Building on this, we introduce an unlearning-friendly watermarking framework, termed Water4MU, to enhance unlearning effectiveness. The core of Water4MU is a bi-level optimization (BLO) framework: at the upper level, the watermarking network is optimized to minimize unlearning difficulty, while at the lower level, the model itself is trained independently of watermarking. Experimental results demonstrate that Water4MU is effective in MU across both image classification and image generation tasks. Notably, it outperforms existing methods in challenging MU scenarios, known as "challenging forgets".

机器遗忘水印技术数据删除

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。