arXiv:2501.13435cs.CV2025-01被引 5

通过融合全局上下文与光流残差,提升深度伪造检测鲁棒性。

GC-ConsFlow: Leveraging Optical Flow Residuals and Global Context for Robust Deepfake Detection

  • 双流架构分别捕捉空间与时间特征,增强对伪造痕迹的感知
  • 在多种压缩条件下,检测准确率优于现有最先进方法
  • 特别适合应对自然面部动作干扰的复杂场景

深度伪造技术的快速发展使得操纵视频日益逼真,带来严重的社会与伦理挑战。现有检测方法多聚焦于空间或时间不一致,常忽略两者关联,或受自然面部运动干扰。为此,我们提出全局上下文一致性光流(GC-ConsFlow)框架,通过双流结构有效整合时空特征。全局分组上下文聚合模块(GGCA)融入全局上下文感知帧光流流(GCAF),通过聚合分组全局上下文信息提升空间特征提取能力,以发现帧内细微空间伪影。流梯度时间一致性流(FGTC)利用光流残差与基于梯度的特征,而非直接建模残差,提高对非自然面部运动引入的时间不一致性的鲁棒性。两流结合可有效捕捉互补的时空伪造痕迹。大量实验表明,GC-ConsFlow在多种压缩场景下均优于现有最先进方法。

原文摘要 · Abstract (English)

The rapid development of Deepfake technology has enabled the generation of highly realistic manipulated videos, posing severe social and ethical challenges. Existing Deepfake detection methods primarily focused on either spatial or temporal inconsistencies, often neglecting the interplay between the two or suffering from interference caused by natural facial motions. To address these challenges, we propose the global context consistency flow (GC-ConsFlow), a novel dual-stream framework that effectively integrates spatial and temporal features for robust Deepfake detection. The global grouped context aggregation module (GGCA), integrated into the global context-aware frame flow stream (GCAF), enhances spatial feature extraction by aggregating grouped global context information, enabling the detection of subtle, spatial artifacts within frames. The flow-gradient temporal consistency stream (FGTC), rather than directly modeling the residuals, it is used to improve the robustness of temporal feature extraction against the inconsistency introduced by unnatural facial motion using optical flow residuals and gradient-based features. By combining these two streams, GC-ConsFlow demonstrates the effectiveness and robustness in capturing complementary spatiotemporal forgery traces. Extensive experiments show that GC-ConsFlow outperforms existing state-of-the-art methods in detecting Deepfake videos under various compression scenarios.

深度伪造光流双流网络鲁棒检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。