arXiv:2507.03636cs.CRcs.CV2025-07被引 1

让AI图像生成只听从授权指令,防止未经授权的修改。

SecureT2I: No More Unauthorized Manipulation on AI Generated Images from Prompts

  • 按权限分类图像,授权的正常编辑,禁止的输出模糊内容
  • 在多个模型和数据集上,禁用编辑时质量下降超80%而授权图像保持高质量
  • 轻量微调即可部署,适合需版权保护的图像生成应用

基于扩散模型的文本引导图像编辑虽灵活精准,但存在未经授权修改的伦理与版权风险。为此,我们提出SecureT2I框架,通过轻量级微调实现对扩散模型的授权控制,无需改变架构。将图像分为允许编辑(permit set)和禁止编辑(forbid set)两类:前者正常生成高质量图像,后者通过特定训练目标生成模糊或语义模糊输出(如模糊图像),以抑制有意义的编辑。核心挑战是在阻止非法编辑的同时保障合法输入的编辑质量。为此,设计了分离的损失函数,实现选择性编辑行为。在多个数据集和模型上的实验表明,SecureT2I在禁止图像上有效降低编辑质量(平均下降超80%),同时在允许图像上保持原有性能。进一步评估发现其对未见过输入具有强泛化能力,且基于缩放的退化策略在安全与效果间取得最佳平衡。

原文摘要 · Abstract (English)

Text-guided image manipulation with diffusion models enables flexible and precise editing based on prompts, but raises ethical and copyright concerns due to potential unauthorized modifications. To address this, we propose SecureT2I, a secure framework designed to prevent unauthorized editing in diffusion-based generative models. SecureT2I is compatible with both general-purpose and domain-specific models and can be integrated via lightweight fine-tuning without architectural changes. We categorize images into a permit set and a forbid set based on editing permissions. For the permit set, the model learns to perform high-quality manipulations as usual. For the forbid set, we introduce training objectives that encourage vague or semantically ambiguous outputs (e.g., blurred images), thereby suppressing meaningful edits. The core challenge is to block unauthorized editing while preserving editing quality for permitted inputs. To this end, we design separate loss functions that guide selective editing behavior. Extensive experiments across multiple datasets and models show that SecureT2I effectively degrades manipulation quality on forbidden images while maintaining performance on permitted ones. We also evaluate generalization to unseen inputs and find that SecureT2I consistently outperforms baselines. Additionally, we analyze different vagueness strategies and find that resize-based degradation offers the best trade-off for secure manipulation control.

图像生成安全控制扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。