通过精准定位扩散过程关键步骤,实现去除非想要内容而不破坏生成能力。
Concept Unlearning by Modeling Key Steps of Diffusion Process
- 基于扩散过程的步骤调度机制,动态识别需优化的关键阶段。
- 在去除裸露内容时达到96.5%准确率,同时保持FID为14.1的高质量生成。
- 适合需要精准控制模型内容输出的研究者与应用开发者。
文本到图像扩散模型仍易生成不期望或有害内容。尽管概念遗忘可缓解此风险,现有方法常面临优化困境:彻底消除语义信息往往导致无关生成能力的灾难性遗忘。为此,我们提出关键步骤概念遗忘(KSCU)。该方法基于信息论深度设计,揭示了步序调度顺序的重要影响,发现传统随机时间步采样严重破坏轨迹依赖性。我们证明,对整个扩散过程无差别处理效率低下,因不同概念的最佳遗忘步长范围各异。不同于全局微调所有时间步,KSCU引入基于序列调度的关键步骤表、CFG感知泄漏补偿和提示增强,动态将优化聚焦于特定概念的活跃区域。该局部策略有效清除目标概念,防止早期步骤过度优化引发的结构崩溃。因此,KSCU显著降低计算开销,并在概念擦除与功能保留间达成当前最优权衡。全面评估显示,其在多种任务中表现卓越,包括裸露、风格、物体类别及大规模实例概念。例如,在裸露内容移除任务中,实现96.5%的遗忘准确率与14.1的先进FID值。
原文摘要 · Abstract (English)
Text-to-image diffusion models remain susceptible to generating undesirable or harmful content. Although concept unlearning mitigates this risk, existing methods struggle with a critical optimization dilemma: thorough semantic erasure frequently induces the catastrophic forgetting of unrelated generative capabilities. To overcome this challenge, we propose Key Step Concept Unlearning (KSCU). Serving as an integrated methodological refinement deeply motivated by information theory, KSCU explores the profound impact of step scheduling order and reveals that traditional randomized timestep sampling severely disrupts trajectory dependency. We demonstrate that indiscriminately targeting the entire diffusion process is inefficient, as the optimal step range for unlearning inherently varies across different concepts. Rather than globally fine-tuning all timesteps, KSCU explicitly integrates a sequential-scheduling-based Key Step Table, CFG-aware leakage compensation, and prompt augmentation to dynamically isolate optimization to a concept-specific active region. This localized strategy successfully eradicates the target concept while preventing the structural collapse caused by early-step over-optimization. Consequently, KSCU significantly reduces computational overhead and establishes a state-of-the-art trade-off between concept erasure and utility retention. Comprehensive evaluations demonstrate that KSCU consistently delivers superior performance across diverse unlearning tasks, including nudity, style, object classes, and mass instance concepts. For example, in nudity removal, KSCU yields a 96.5% unlearning accuracy alongside a state-of-the-art FID of 14.1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。