首次无需水印即可追踪换脸内容背后的原始人物身份。
FaceTracer: Unveiling Source Identities from Swapped Face Images and Videos for Fraud Prevention
- 通过解耦模块分离源人物身份特征,抑制目标人物信息。
- 在多种换脸技术下均能准确识别源身份,支持未见方法迁移。
- 适合反欺诈、司法取证等需要溯源的场景使用。
随着深度学习的发展,人脸换脸技术迅速进步,其滥用引发广泛担忧,尤其在欺诈场景中。现有检测方法多聚焦于识别换脸图像或视频,但无法追溯恶意行为者。基于水印的方法对未标记内容无效,实用性受限。为此,我们提出首个非侵入式框架 FaceTracer,专门用于从换脸图像或视频中追溯源人物身份。FaceTracer 采用解耦模块,有效抑制目标人物身份信息,同时保留源人物的可识别特征,从而提取出可直接关联原始个体的身份信息,助力揭示欺诈行为背后的真实用户。大量实验表明,FaceTracer 在多种换脸技术中均表现高效,能成功定位源身份,并具备对未知换脸方法、商业应用、传输失真及自适应攻击的强泛化能力。代码已开源。
原文摘要 · Abstract (English)
Face-swapping techniques have advanced rapidly with the evolution of deep learning, leading to widespread use and growing concerns about potential misuse, especially in cases of fraud. While many efforts have focused on detecting swapped face images or videos, these methods are insufficient for tracing the malicious users behind fraudulent activities. Intrusive watermark-based approaches also fail to trace unmarked identities, limiting their practical utility. To address these challenges, we introduce FaceTracer, the first non-intrusive framework specifically designed to trace the identity of the source person from swapped face images or videos. Specifically, FaceTracer leverages a disentanglement module that effectively suppresses identity information related to the target person while isolating the identity features of the source person. This allows us to extract robust identity information that can directly link the swapped face back to the original individual, aiding in uncovering the actors behind fraudulent activities. Extensive experiments demonstrate FaceTracer's effectiveness across various face-swapping techniques, successfully identifying the source person in swapped content and enabling the tracing of malicious actors involved in fraudulent activities. Additionally, FaceTracer shows strong transferability to unseen face-swapping methods including commercial applications and robustness against transmission distortions and adaptive attacks.Our code is available at: https://github.com/zzy224/FaceTracer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。