通过梯度引导流匹配,精准逆向生成目标人脸图像。
Steering the Flow: Inverting Face Recognition Models via Gradient-Guided Flow Matching

- 将逆向攻击重构为轨迹引导问题,分两阶段优化生成路径。
- 在CelebA上实现0.9248准确率、22.61的FID,效果领先。
- 适合研究模型安全与对抗性生成的学者快速掌握前沿方法。
模型逆向攻击旨在从人脸识别模型中重建目标身份的代表性训练样本,暴露关键安全漏洞。现有方法多依赖间接或高度随机的引导,难以稳定优化生成轨迹。本文提出新型两阶段白盒逆向攻击方法SFMI,将逆向过程重构为轨迹引导任务:第一阶段,预训练通用无条件流匹配模型,构建人类人脸分布的稳健先验;第二阶段,攻击时引入时间依赖的目标特定梯度,在采样过程中通过反向传播获取中间生成状态的梯度,动态注入自适应引导信号至向量场。该过程有效将生成流从随机噪声引导至目标类别的高密度区域。在使用CelebA数据集的身份无关交叉评估设置下,SFMI在ArcFace目标模型上达到0.9248的准确率、22.61的FID和0.3874的LPIPS。多目标模型实验表明,SFMI在白盒协议下实现了领先的攻击成功率与视觉保真度。
原文摘要 · Abstract (English)
Model Inversion Attacks (MIAs) aim to reconstruct representative training samples of target identities from face recognition models, exposing critical security vulnerabilities. Existing methods typically rely on indirect guidance or highly stochastic guidance, making it difficult to stably optimize generation trajectories toward target facial images. In this paper, we propose Steering Flow Model Inversion (SFMI), a novel two-stage white-box model inversion method that reformulates inversion as a trajectory-steering task. Specifically, Step I, Learning a Generic Flow Matching Prior, pre-trains a generic unconditional Flow Matching model to encode the manifold of human faces as a robust prior. Step II, Attacking with Progressive Guidance Scheduler (PGS), injects time-dependent target-specific gradients during sampling. By backpropagating through the target model to obtain gradients from intermediate generated states, PGS progressively injects adaptive guidance signals into the vector field. This process effectively steers the current generative flow from random noise toward the high-density regions of the target class. Under an identity-disjoint cross-evaluation setting using the CelebA dataset, SFMI achieves an ACC of 0.9248, an FID of 22.61, and an LPIPS of 0.3874 on the ArcFace target. Extensive experiments on multiple target models demonstrate that SFMI achieves competitive state-of-the-art performance in attack success and visual fidelity under the evaluated white-box protocol.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。