构建真实世界深伪人脸数据集,提升检测模型实战能力。
Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Faces
- 用9个商用平台生成真实深伪图像与视频,模拟黑盒场景。
- 包含超6万张伪造图像和1000段篡改视频,覆盖多样手法。
- 适合研究真实场景下深伪检测的学者与安全工程师。
深度伪造利用先进的人工智能生成内容技术,创建高度逼真的合成人脸图像与视频,对社交媒体的真实性构成重大威胁。尽管此类威胁日益普遍,现有学术评估与基准测试在实用性、深伪多样性及操纵技术覆盖范围方面仍显不足。为解决这些问题,我们提出RedFace(面向真实世界的深伪人脸)数据集,包含超过60,000张伪造图像和1,000段篡改视频,均基于真实人脸特征生成。与以往依赖学术方法生成深伪不同,RedFace通过整合9个商业在线平台的最新技术,真实还原“在野”环境中的黑盒深伪流程。此外,采用定制算法合成,可捕捉现实世界中不断演化的伪造方法。在RedFace上的广泛实验(包括跨域、同域及社交网络传播模拟)验证了现有检测方案在真实场景下的局限性。我们还对数据集进行了详细分析,揭示其对检测性能影响的原因。数据集已开源:https://github.com/kikyou-220/RedFace。
原文摘要 · Abstract (English)
Deepfakes, leveraging advanced AIGC (Artificial Intelligence-Generated Content) techniques, create hyper-realistic synthetic images and videos of human faces, posing a significant threat to the authenticity of social media. While this real-world threat is increasingly prevalent, existing academic evaluations and benchmarks for detecting deepfake forgery often fall short to achieve effective application for their lack of specificity, limited deepfake diversity, restricted manipulation techniques.To address these limitations, we introduce RedFace (Real-world-oriented Deepfake Face), a specialized facial deepfake dataset, comprising over 60,000 forged images and 1,000 manipulated videos derived from authentic facial features, to bridge the gap between academic evaluations and real-world necessity. Unlike prior benchmarks, which typically rely on academic methods to generate deepfakes, RedFace utilizes 9 commercial online platforms to integrate the latest deepfake technologies found "in the wild", effectively simulating real-world black-box scenarios.Moreover, RedFace's deepfakes are synthesized using bespoke algorithms, allowing it to capture diverse and evolving methods used by real-world deepfake creators. Extensive experimental results on RedFace (including cross-domain, intra-domain, and real-world social network dissemination simulations) verify the limited practicality of existing deepfake detection schemes against real-world applications. We further perform a detailed analysis of the RedFace dataset, elucidating the reason of its impact on detection performance compared to conventional datasets. Our dataset is available at: https://github.com/kikyou-220/RedFace.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。