用动态3D面具保护人脸,防被随意识别和追踪。
Protego: User-Centric Pose-Invariant Privacy Protection Against Face Recognition-Induced Digital Footprint Exposure
- 将用户3D脸型转为姿态不变的2D表示,生成自然贴合的3D面具
- 使被保护图像在多种人脸识别模型下匹配率大幅下降,性能超现有方法2倍以上
- 适合关注隐私、常分享人脸影像的普通用户使用
人脸识别技术广泛用于大规模图像检索系统,引发严重隐私问题。像Clearview AI和PimEyes这样的服务允许用户上传一张人脸照片,即可获取该人的大量网络关联内容,包括社交媒体活动、私密照片和新闻报道,且常未经本人同意。针对这一威胁,我们提出Protego,一种以用户为中心的隐私保护方法,可防止面部图像被用于检索式隐私侵犯。Protego将用户的3D面部特征封装为姿态不变的2D表示,并动态生成与任意人脸图像姿态和表情匹配的自然3D面具,应用于在线分享前。针对现有方法的关键缺陷,Protego增强人脸识别模型的敏感性,使得受保护图像彼此也无法匹配。实验表明,Protego显著降低了多种黑盒人脸识别模型的检索准确率,性能至少优于现有方法2倍;同时在视频场景中展现出前所未有的视觉连贯性,保持自然外观和一致性。Protego有助于遏制人脸识别被滥用于大规模监控和未经授权的身份追踪。
原文摘要 · Abstract (English)
Face recognition (FR) technologies are increasingly used to power large-scale image retrieval systems, raising serious privacy concerns. Services like Clearview AI and PimEyes allow anyone to upload a facial photo and retrieve a large amount of online content associated with that person. This not only enables identity inference but also exposes their digital footprint, such as social media activity, private photos, and news reports, often without their consent. In response to this emerging threat, we propose Protego, a user-centric privacy protection method that safeguards facial images from such retrieval-based privacy intrusions. Protego encapsulates a user's 3D facial signatures into a pose-invariant 2D representation, which is dynamically deformed into a natural-looking 3D mask tailored to the pose and expression of any facial image of the user, and applied prior to online sharing. Motivated by a critical limitation of existing methods, Protego amplifies the sensitivity of FR models so that protected images cannot be matched even among themselves. Experiments show that Protego significantly reduces retrieval accuracy across a wide range of black-box FR models and performs at least 2x better than existing methods. It also offers unprecedented visual coherence, particularly in video settings where consistency and natural appearance are essential. Overall, Protego contributes to the fight against the misuse of FR for mass surveillance and unsolicited identity tracing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。