arXiv:2409.03434cs.CRcs.CV2024-09中稿 · NDSS Symposium 202…被引 9

用密钥控制虚拟人脸,既能保护隐私又能恢复原身份。

A Key-Driven Framework for Identity-Preserving Face Anonymization

  • 通过密钥驱动生成保留姿态的表情的虚拟人脸
  • 支持用正确密钥识别虚拟脸并还原原始身份
  • 适合需要隐私保护又需身份验证的元宇宙场景

虚拟人脸在元宇宙中至关重要。目前的虚拟人脸生成方法要么永久删除可识别信息,要么将原身份映射为虚拟身份,导致无法恢复。本研究首次解决虚拟人脸中隐私与可识别性的矛盾,提出关键驱动的人脸匿名化与认证识别(KFAAR)框架。该框架包含头姿态保持的虚拟人脸生成(HPVFG)模块和密钥可控的虚拟人脸认证(KVFA)模块。HPVFG模块利用用户密钥将原人脸潜在向量投影为虚拟向量,并生成扩展编码以生成虚拟人脸;同时加入头姿态和表情修正模块,确保虚拟人脸与原图姿态、表情一致。认证阶段,通过正确密钥可直接识别虚拟脸并还原原始身份,无需暴露原图。此外,设计多任务学习目标联合训练HPVFG与KVFA模块。大量实验验证了该框架在实现面部匿名性与可识别性方面的有效性。

原文摘要 · Abstract (English)

Virtual faces are crucial content in the metaverse. Recently, attempts have been made to generate virtual faces for privacy protection. Nevertheless, these virtual faces either permanently remove the identifiable information or map the original identity into a virtual one, which loses the original identity forever. In this study, we first attempt to address the conflict between privacy and identifiability in virtual faces, where a key-driven face anonymization and authentication recognition (KFAAR) framework is proposed. Concretely, the KFAAR framework consists of a head posture-preserving virtual face generation (HPVFG) module and a key-controllable virtual face authentication (KVFA) module. The HPVFG module uses a user key to project the latent vector of the original face into a virtual one. Then it maps the virtual vectors to obtain an extended encoding, based on which the virtual face is generated. By simultaneously adding a head posture and facial expression correction module, the virtual face has the same head posture and facial expression as the original face. During the authentication, we propose a KVFA module to directly recognize the virtual faces using the correct user key, which can obtain the original identity without exposing the original face image. We also propose a multi-task learning objective to train HPVFG and KVFA. Extensive experiments demonstrate the advantages of the proposed HPVFG and KVFA modules, which effectively achieve both facial anonymity and identifiability.

人脸识别隐私保护元宇宙

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。