arXiv:2601.04282cs.LG2026-01被引 1

让生成模型遗忘特定身份信息,像流水一样自然可控。

LEGATO: Good Identity Unlearning Is Continuous

  • 用神经微分方程构建连续遗忘路径,避免反复调参
  • 仅需微调少量参数,遗忘强度可精确调节
  • 防止模型性能崩塌,适合需要隐私保护的生成应用

机器遗忘在生成模型中至关重要,用于移除敏感、私密或受版权保护的数据。现有方法面临三大挑战:1)效率低,遗忘需微调全部参数;2)控制力差,遗忘强度不可控且缺乏解释性;3)灾难性崩溃,遗忘过程中模型保留能力急剧下降。传统遗忘依赖离散不稳定更新,常需全模型微调并导致性能崩溃。本文提出LEGATO——通过轨迹一致的神经微分方程,在预训练生成器上添加可微调的轻量级神经ODE适配器,实现平滑、可控的遗忘,同时冻结原始模型权重。遗忘强度可通过ODE步长精确调控,提升可解释性与鲁棒性。引入轨迹一致性约束,有效防止遗忘过程中的灾难性崩溃。跨域与非域身份遗忘基准测试表明,LEGATO达到当前最优遗忘性能,避免崩溃,且微调参数显著减少。

原文摘要 · Abstract (English)

Machine unlearning has become a crucial role in enabling generative models trained on large datasets to remove sensitive, private, or copyright-protected data. However, existing machine unlearning methods face three challenges in learning to forget identity of generative models: 1) inefficient, where identity erasure requires fine-tuning all the model's parameters; 2) limited controllability, where forgetting intensity cannot be controlled and explainability is lacking; 3) catastrophic collapse, where the model's retention capability undergoes drastic degradation as forgetting progresses. Forgetting has typically been handled through discrete and unstable updates, often requiring full-model fine-tuning and leading to catastrophic collapse. In this work, we argue that identity forgetting should be modeled as a continuous trajectory, and introduce LEGATO - Learn to ForgEt Identity in GenerAtive Models via Trajectory-consistent Neural Ordinary Differential Equations. LEGATO augments pre-trained generators with fine-tunable lightweight Neural ODE adapters, enabling smooth, controllable forgetting while keeping the original model weights frozen. This formulation allows forgetting intensity to be precisely modulated via ODE step size, offering interpretability and robustness. To further ensure stability, we introduce trajectory consistency constraints that explicitly prevent catastrophic collapse during unlearning. Extensive experiments across in-domain and out-of-domain identity unlearning benchmarks show that LEGATO achieves state-of-the-art forgetting performance, avoids catastrophic collapse and reduces fine-tuned parameters.

生成模型机器遗忘神经ODE隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。