用文本控制生成模糊人脸,保护隐私同时保持图像真实
Facial Attribute Based Text Guided Face Anonymization
- 三阶段流程:检测人脸、提取特征、用扩散模型生成带属性的匿名脸
- 结合文本提示控制年龄、性别等属性,生成自然且无法识别的人脸
- 无需训练GAN,适合需要隐私合规数据集的研究者使用
计算机视觉应用日益普及,处理大量含个人身份信息的视觉数据成为挑战。尽管技术带来诸多益处,但必须兼顾隐私保护。现行数据隐私法规要求个体同意才能处理其个人信息,限制了高质量人脸数据集的收集。本文提出一种基于深度学习的面部匿名化流水线,克服该难题。不同于多数现有方法,本方法利用基于扩散模型的图像修复技术,无需训练生成对抗网络。流程包括三步:使用RetinaNet进行人脸检测,通过VGG-Face提取特征,再借助当前最先进的BrushNet扩散模型生成真实感人脸。BrushNet结合完整图像、人脸掩码及指定面部属性(如年龄、种族、性别、表情)的文本提示,实现不可识别且外观自然的人脸生成,从而支持构建符合隐私规范的计算机视觉研究数据集。
原文摘要 · Abstract (English)
The increasing prevalence of computer vision applications necessitates handling vast amounts of visual data, often containing personal information. While this technology offers significant benefits, it should not compromise privacy. Data privacy regulations emphasize the need for individual consent for processing personal data, hindering researchers' ability to collect high-quality datasets containing the faces of the individuals. This paper presents a deep learning-based face anonymization pipeline to overcome this challenge. Unlike most of the existing methods, our method leverages recent advancements in diffusion-based inpainting models, eliminating the need for training Generative Adversarial Networks. The pipeline employs a three-stage approach: face detection with RetinaNet, feature extraction with VGG-Face, and realistic face generation using the state-of-the-art BrushNet diffusion model. BrushNet utilizes the entire image, face masks, and text prompts specifying desired facial attributes like age, ethnicity, gender, and expression. This enables the generation of natural-looking images with unrecognizable individuals, facilitating the creation of privacy-compliant datasets for computer vision research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。