新合成技术让假视频更逼真,现有检测方法跟不上了。
Deepfake Synthesis vs. Detection: An Uneven Contest
- 对比最新生成技术测试主流检测模型
- 顶尖合成视频让模型和人识别准确率暴跌
- 呼吁加强检测算法研发应对伪造威胁
深度伪造技术的快速进步显著提升了合成媒体的真实感与可及性。基于扩散模型、神经辐射场(NeRF)以及传统生成对抗网络(GANs)的改进,使深度伪造视频的生成更加精巧。与此同时,检测方法也取得进展,得益于Transformer架构、对比学习等机器学习创新。本文对当前最先进的深度伪造检测技术进行综合性实证分析,包括与前沿生成技术的人类评估实验。结果表明:许多先进检测模型在面对现代生成技术制造的深度伪造视频时表现明显不佳,人类参与者对高质量伪造视频的识别准确率同样低下。通过大量实验,我们证实了当前检测方法与新一代生成技术之间存在显著能力差距,亟需持续优化检测模型以应对不断演进的伪造技术挑战。
原文摘要 · Abstract (English)
The rapid advancement of deepfake technology has significantly elevated the realism and accessibility of synthetic media. Emerging techniques, such as diffusion-based models and Neural Radiance Fields (NeRF), alongside enhancements in traditional Generative Adversarial Networks (GANs), have contributed to the sophisticated generation of deepfake videos. Concurrently, deepfake detection methods have seen notable progress, driven by innovations in Transformer architectures, contrastive learning, and other machine learning approaches. In this study, we conduct a comprehensive empirical analysis of state-of-the-art deepfake detection techniques, including human evaluation experiments against cutting-edge synthesis methods. Our findings highlight a concerning trend: many state-of-the-art detection models exhibit markedly poor performance when challenged with deepfakes produced by modern synthesis techniques, including poor performance by human participants against the best quality deepfakes. Through extensive experimentation, we provide evidence that underscores the urgent need for continued refinement of detection models to keep pace with the evolving capabilities of deepfake generation technologies. This research emphasizes the critical gap between current detection methodologies and the sophistication of new generation techniques, calling for intensified efforts in this crucial area of study.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。