用通用伪装罩保护个人所有图像,防个性化图像生成泄露隐私
ID-Cloak: Crafting Identity-Specific Cloaks Against Personalized Text-to-Image Generation
- 构建身份子空间,捕捉个人图像共性特征
- 设计通用伪装罩,使模型输出偏离身份特征分布
- 首次实现对单一身份所有图像的统一隐私保护
个性化文生图模型可通过少量参考图生成新概念图像,引发严重隐私担忧。现有防护方法多依赖为每张图定制伪装罩,但面对海量在线个人图像,该方式难以实用。本文首次提出身份特定伪装罩(ID-Cloak),旨在保护某一身份下的全部图像。首先建模身份子空间以保留个人共性,并学习多样化上下文以捕捉待保护图像分布;随后通过新目标函数生成伪装罩,引导模型在子空间内远离正常输出。大量实验表明,生成的通用伪装罩能有效保护图像。我们认为该方法与提出的身份特定防护设定,标志着真实场景隐私保护的重要进展。
原文摘要 · Abstract (English)
Personalized text-to-image models allow users to generate images of new concepts from several reference photos, thereby leading to critical concerns regarding civil privacy. Although several anti-personalization techniques have been developed, these methods typically assume that defenders can afford to design a privacy cloak corresponding to each specific image. However, due to extensive personal images shared online, image-specific methods are limited by real-world practical applications. To address this issue, we are the first to investigate the creation of identity-specific cloaks (ID-Cloak) that safeguard all images belong to a specific identity. Specifically, we first model an identity subspace that preserves personal commonalities and learns diverse contexts to capture the image distribution to be protected. Then, we craft identity-specific cloaks with the proposed novel objective that encourages the cloak to guide the model away from its normal output within the subspace. Extensive experiments show that the generated universal cloak can effectively protect the images. We believe our method, along with the proposed identity-specific cloak setting, marks a notable advance in realistic privacy protection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。