arXiv:2509.21433cs.CVcs.AI2025-09被引 3

让扩散模型按需擦除多个视觉概念,避免风格侵权。

DyME: Dynamic Multi-Concept Erasure in Diffusion Models with Bi-Level Orthogonal LoRA Adaptation

  • 用动态组合的轻量LoRA适配器,按需擦除不同概念。
  • 在多概念擦除任务中保持高精度,非目标内容损失小。
  • 适合需要灵活处理版权内容的AI图像生成场景。

文本到图像扩散模型可能无意复现受版权保护的风格和视觉概念,引发法律与伦理问题。概念擦除作为防护手段,旨在通过微调有选择地抑制这些概念。然而,现有方法难以扩展至实际应用中需同时擦除多个且可能冲突的概念。核心瓶颈在于其依赖静态擦除:单一检查点被微调以去除所有目标概念,无论推理时实际需求如何。这种僵化设计与真实使用场景脱节,导致擦除成功率下降,非目标内容保真度降低。本文提出DyME,一种按需擦除框架,训练轻量级、特定概念的LoRA适配器,并在推理时仅动态组合所需部分。该模块化设计支持灵活的多概念擦除,但简单拼接会引发适配器间干扰,尤其在多概念或语义相关概念抑制时。为此,我们在特征与参数两个层面引入双层正交约束,解耦表示变化并强制适配器子空间正交。我们进一步构建了新基准ErasureBench-H,具有品牌-系列-角色的层次结构,支持跨语义粒度与擦除集合大小的系统评估。在ErasureBench-H及标准数据集(如CIFAR-100、Imagenette)上的实验表明,DyME持续优于最先进基线,在多概念擦除保真度上更高,且附带损伤极小。

原文摘要 · Abstract (English)

Text-to-image diffusion models (DMs) inadvertently reproduce copyrighted styles and protected visual concepts, raising legal and ethical concerns. Concept erasure has emerged as a safeguard, aiming to selectively suppress such concepts through fine-tuning. However, existing methods do not scale to practical settings where providers must erase multiple and possibly conflicting concepts. The core bottleneck is their reliance on static erasure: a single checkpoint is fine-tuned to remove all target concepts, regardless of the actual erasure needs at inference. This rigid design mismatches real-world usage, where requests vary per generation, leading to degraded erasure success and reduced fidelity for non-target content. We propose DyME, an on-demand erasure framework that trains lightweight, concept-specific LoRA adapters and dynamically composes only those needed at inference. This modular design enables flexible multi-concept erasure, but naive composition causes interference among adapters, especially when many or semantically related concepts are suppressed. To overcome this, we introduce bi-level orthogonality constraints at both the feature and parameter levels, disentangling representation shifts and enforcing orthogonal adapter subspaces. We further develop ErasureBench-H, a new hierarchical benchmark with brand-series-character structure, enabling principled evaluation across semantic granularities and erasure set sizes. Experiments on ErasureBench-H and standard datasets (e.g., CIFAR-100, Imagenette) demonstrate that DyME consistently outperforms state-of-the-art baselines, achieving higher multi-concept erasure fidelity with minimal collateral degradation.

扩散模型概念擦除LoRA版权防护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。