保护视觉检索生成中的隐私,分离人脸身份与特征实现安全匿名化
Identity-Decoupled Anonymization for Visual Evidence in Multi-modal Retrieval-Augmented Generation

- 将人脸分解为身份码和属性码,通过正则化保持特征独立性
- 用真实且不重合的合成身份替换原身份,确保隐私不泄露
- 采用扩散模型生成匿名人脸,适合高要求的低延迟应用
多模态检索增强生成(MRAG)系统从大规模图像库中检索视觉证据以支撑大模型的回答,但检索图像常包含人脸,其身份属于敏感个人信息。现有匿名化方法要么破坏下游推理所需的非身份视觉线索,要么缺乏可靠的隐私保障。本文提出身份解耦式MRAG框架,在检索与生成间插入生成式匿名模块。该框架包含三部分:(i) 解耦变分编码器,将人脸分解为身份码与空间结构属性码,通过互信息惩罚和梯度独立项正则化;(ii) 流形感知拒绝采样器,用保证与原身份不同且真实的合成身份替换身份码;(iii) 条件潜在扩散生成器,基于替换身份与保留属性合成匿名人脸,并蒸馏为潜在一致性模型以实现低延迟部署。隐私通过多预言机人脸识别集成与基于铰链损失的优化终止机制保障,当身份相似度低于伪造者区间阈值时停止优化。
原文摘要 · Abstract (English)
Multi-modal retrieval-augmented generation (MRAG) systems retrieve visual evidence from large image corpora to ground the responses of large multi-modal models, yet the retrieved images frequently contain human faces whose identities constitute sensitive personal information. Existing anonymization techniques that destroy the non-identity visual cues that downstream reasoning depends on or fail to provide principled privacy guarantees. We propose Identity-Decoupled MRAG, a framework that interposes a generative anonymization module between retrieval and generation. Our approach consists of three components: (i)a disentangled variational encoder that factorizes each face into an identity code and a spatially-structured attribute code, regularized by a mutual-information penalty and a gradient-based independence term; (ii)a manifold-aware rejection sampler that replaces the identity code with a synthetic one guaranteed to be both distinct from the original and realistic; and (iii)a conditional latent diffusion generator that synthesizes the anonymized face from the replacement identity and the preserved attributes, distilled into a latent consistency model for low-latency deployment. Privacy is enforced through a multi-oracle ensemble of face recognition models with a hinge-based loss that halts optimization once identity similarity drops below the impostor-regime threshold.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。