通过融合身份、行为与几何特征,提升深伪检测在真实社交平台的泛化能力。
Securing Social Media Against Deepfakes using Identity, Behavioral, and Geometric Signatures
- 整合身份、行为、几何三类特征,构建统一检测框架
- 跨数据集测试中性能超越多个主流方法
- 适合需要应对未知深伪攻击的平台安全团队
社交媒体中的信任危机日益严重,主要源于深伪多媒体内容对社会舆论的影响。尽管已有大量研究致力于深伪检测,但现有方法普遍存在泛化能力差的问题:仅对特定类型的深伪内容有效,难以应对未见过或形式多变的伪造内容,限制了其在真实场景(如社交平台)的应用。为解决这一问题,本文提出一种新型深伪检测框架,采用集成深度身份、行为与几何(DBaG)签名的特征描述子,并设计名为DBaGNet的分类器。该分类器利用抽取的DBaG签名,通过三元组损失函数增强泛化表示学习,提升分类效果。为验证方法的有效性与泛化能力,我们在六个基准数据集(WLDR、CelebDF、DFDC、FaceForensics++、DFD、NVFAIR)上进行了广泛实验,包括跨数据集评估,结果表明该方法显著优于多个当前先进方法。
原文摘要 · Abstract (English)
Trust in social media is a growing concern due to its ability to influence significant societal changes. However, this space is increasingly compromised by various types of deepfake multimedia, which undermine the authenticity of shared content. Although substantial efforts have been made to address the challenge of deepfake content, existing detection techniques face a major limitation in generalization: they tend to perform well only on specific types of deepfakes they were trained on.This dependency on recognizing specific deepfake artifacts makes current methods vulnerable when applied to unseen or varied deepfakes, thereby compromising their performance in real-world applications such as social media platforms. To address the generalizability of deepfake detection, there is a need for a holistic approach that can capture a broader range of facial attributes and manipulations beyond isolated artifacts. To address this, we propose a novel deepfake detection framework featuring an effective feature descriptor that integrates Deep identity, Behavioral, and Geometric (DBaG) signatures, along with a classifier named DBaGNet. Specifically, the DBaGNet classifier utilizes the extracted DBaG signatures, leveraging a triplet loss objective to enhance generalized representation learning for improved classification. Specifically, the DBaGNet classifier utilizes the extracted DBaG signatures and applies a triplet loss objective to enhance generalized representation learning for improved classification. To test the effectiveness and generalizability of our proposed approach, we conduct extensive experiments using six benchmark deepfake datasets: WLDR, CelebDF, DFDC, FaceForensics++, DFD, and NVFAIR. Specifically, to ensure the effectiveness of our approach, we perform cross-dataset evaluations, and the results demonstrate significant performance gains over several state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。