将概念擦除转化为奖励优化,实现更安全可控的图像生成。
FlowErase-RL: Rethinking Concept Erasure as Reward Optimization in Flow Matching Models

- 将概念擦除建模为奖励优化问题,设计动态双路径奖励机制。
- 在多个场景下实现顶尖擦除效果,同时保持高质量和语义一致性。
- 无需标注数据,可扩展至多概念场景,抗攻击性强。
流匹配模型虽显著提升了文生图质量,但也带来了生成有害内容的安全风险。现有概念擦除方法或为推理时干预(效果有限),或依赖需精准对齐数据的监督微调(难扩展、不支持多概念)。本文提出首个基于GRPO的流匹配模型概念擦除框架FlowErase-RL,将概念擦除重构为奖励优化问题,引入动态双路径奖励机制:(i) 概念擦除(CE)奖励抑制目标概念,(ii) 非目标空间(NS)奖励保持生成保真度。通过性能驱动的自适应切换策略,在训练中动态平衡两路径,实现无显式监督的稳定优化。在裸露、物体及艺术风格擦除任务上的大量实验表明,本方法在保持强图像质量与语义对齐的同时,达到当前最优擦除性能,并对对抗攻击具有鲁棒性,能有效扩展至多概念场景。结果确立了流匹配模型中安全可控生成的新范式。
原文摘要 · Abstract (English)
Recent advances in flow matching models have significantly improved text-to-image generation quality, but also introduce growing safety risks due to the generation of harmful or undesirable content. Existing concept erasure methods are either inference-time interventions with limited effectiveness or rely on supervised fine-tuning (SFT), which requires precisely aligned data and struggles with scalability and multi-concept settings. In this paper, we propose \emph{FlowErase-RL}, the first GRPO-based framework for concept erasure in flow matching models. We reformulate concept erasure as a reward optimization problem and introduce a \textbf{dynamic dual-path reward mechanism} that jointly optimizes (i) a Concept Erasure (CE) reward to suppress target concepts and (ii) a Non-target Space (NS) reward to preserve generative fidelity. The two reward paths are adaptively balanced during training via a performance-driven switching strategy, enabling stable optimization without explicit supervision. Extensive experiments on nudity, object, and artistic style erasure demonstrate that our method achieves state-of-the-art erasure performance while maintaining strong image quality and semantic alignment. Moreover, it exhibits robust resistance to adversarial attacks and scales effectively to multi-concept scenarios. Our results establish a new paradigm for safe and controllable generation in flow matching models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。