arXiv:2412.07229cs.LGcs.CV2024-12ICCV被引 4

提出可调控生成模型泛化能力的新方法,防止生成有害内容。

Moderating the Generalization of Score-based Generative Model

  • 通过调整得分函数,在生成过程中避开不良数据
  • 大幅降低生成有害内容概率,同时保持图像质量
  • 适用于多种扩散模型,支持零样本迁移

得分型生成模型(SGMs)展现出强大泛化能力,能生成未见但自然的数据。然而泛化越强,越容易产生意外生成内容,存在滥用风险。现有机器遗忘的‘金标准’——移除不良训练数据后重新训练,在SGMs中无效。分析表明该方法不改变原始得分函数,因此无效。为此,我们提出首个可控得分型生成模型(MSGM),引入新型得分调整策略,在连续时间随机微分方程过程中引导得分函数远离不良数据。大量实验显示,MSGM显著降低生成不良内容的概率,同时保持正常图像生成的高质量。尽管专为SGMs设计,MSGM是一种通用灵活的机器遗忘框架,兼容多种扩散架构(SGM与DDPM)和训练策略(重训练与微调),并支持预训练模型零样本迁移至图像修复、补全等下游任务。代码将在接受后公开。

原文摘要 · Abstract (English)

Score-based Generative Models (SGMs) have demonstrated remarkable generalization abilities, e.g. generating unseen, but natural data. However, the greater the generalization power, the more likely the unintended generalization, and the more dangerous the abuse. Research on moderated generalization in SGMs remains limited. To fill this gap, we first examine the current 'gold standard' in Machine Unlearning (MU), i.e., re-training the model after removing the undesirable training data, and find it does not work in SGMs. Further analysis of score functions reveals that the MU 'gold standard' does not alter the original score function, which explains its ineffectiveness. Based on this insight, we propose the first Moderated Score-based Generative Model (MSGM), which introduces a novel score adjustment strategy that redirects the score function away from undesirable data during the continuous-time stochastic differential equation process. Extensive experimental results demonstrate that MSGM significantly reduces the likelihood of generating undesirable content while preserving high visual quality for normal image generation. Albeit designed for SGMs, MSGM is a general and flexible MU framework that is compatible with diverse diffusion architectures (SGM and DDPM) and training strategies (re-training and fine-tuning), and enables zero-shot transfer of the pre-trained models to downstream tasks, e.g. image inpainting and reconstruction. The code will be shared upon acceptance.

生成模型可控生成机器遗忘扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。