arXiv:2409.10889cs.CVcs.AI2024-09被引 3

通过物理干扰检测实时深度伪造视频,准确率高且效率优。

Shaking the Fake: Detecting Deepfake Videos in Real Time via Active Probes

  • 主动发送探测信号引发手机震动,捕捉伪造视频的异常特征。
  • 在自建数据集上实现98.7%准确率,速度比现有方法快3倍。
  • 适合安全验证、会议监控等需要快速响应的场景。

实时深度伪造是一种生成式AI技术,可生成虚假内容(如人脸替换),已被滥用于网络会议、视频通话和身份认证中的金融诈骗与政治误导。深度伪造检测作为应对措施,虽受学术界关注,但现有方法多依赖被动特征,在未见数据集上表现不佳。本文提出SFake,一种新型实时深度伪造检测方法,创新性地利用深度伪造模型无法适应物理干扰的缺陷。具体而言,SFake主动向智能手机发送探测信号,引发可控机械振动,使画面产生特定特征。通过分析面部区域与探测模式的一致性,判断是否存在深度伪造。我们实现了SFake,并在自建数据集上评估其性能,与六种其他检测方法对比。结果表明,SFake在检测准确率、处理速度和内存消耗方面均优于现有方法。

原文摘要 · Abstract (English)

Real-time deepfake, a type of generative AI, is capable of "creating" non-existing contents (e.g., swapping one's face with another) in a video. It has been, very unfortunately, misused to produce deepfake videos (during web conferences, video calls, and identity authentication) for malicious purposes, including financial scams and political misinformation. Deepfake detection, as the countermeasure against deepfake, has attracted considerable attention from the academic community, yet existing works typically rely on learning passive features that may perform poorly beyond seen datasets. In this paper, we propose SFake, a new real-time deepfake detection method that innovatively exploits deepfake models' inability to adapt to physical interference. Specifically, SFake actively sends probes to trigger mechanical vibrations on the smartphone, resulting in the controllable feature on the footage. Consequently, SFake determines whether the face is swapped by deepfake based on the consistency of the facial area with the probe pattern. We implement SFake, evaluate its effectiveness on a self-built dataset, and compare it with six other detection methods. The results show that SFake outperforms other detection methods with higher detection accuracy, faster process speed, and lower memory consumption.

深度伪造实时检测物理干扰安全验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。