arXiv:2511.07051cs.CVcs.CR2025-11

用强化学习动态生成伪造数据,提升检测模型泛化能力

Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentation

  • 用强化学习动态选择伪造操作,随检测器进展逐步增加难度
  • 在多个跨域数据集上超越现有最优方法,显著提升泛化性能
  • 适合关注真实世界伪造检测泛化性的研究者与工程师

深度伪造检测器的泛化能力对实际应用至关重要。通过合成伪造人脸进行数据增强可有效提升泛化性,但当前最先进方法依赖固定策略,引发关键问题:单一静态增强是否足够?真实世界伪造(如面部扭曲、表情操控)日益复杂,固定策略难以充分模拟。为此,我们提出CRDA(课程强化学习数据增强)框架,引导检测器从简单到复杂逐步掌握多领域伪造特征。CRDA通过可配置的伪造操作池生成增强样本,并根据检测器当前学习状态动态生成对抗样本。核心在于融合强化学习与因果推断:强化学习代理基于检测性能动态选择增强动作,高效探索广阔增强空间;同时引入动作空间变化,生成多样化伪造模式,借助因果推断抑制虚假相关性,消除任务无关偏差,聚焦因果不变特征。该集成确保合成增强模式与模型表征解耦,实现鲁棒泛化。大量实验表明,本方法显著提升检测器泛化能力,在多个跨域数据集上超越现有最先进方法。

原文摘要 · Abstract (English)

The generalization capability of deepfake detectors is critical for real-world use. Data augmentation via synthetic fake face generation effectively enhances generalization, yet current SoTA methods rely on fixed strategies-raising a key question: Is a single static augmentation sufficient, or does the diversity of forgery features demand dynamic approaches? We argue existing methods overlook the evolving complexity of real-world forgeries (e.g., facial warping, expression manipulation), which fixed policies cannot fully simulate. To address this, we propose CRDA (Curriculum Reinforcement-Learning Data Augmentation), a novel framework guiding detectors to progressively master multi-domain forgery features from simple to complex. CRDA synthesizes augmented samples via a configurable pool of forgery operations and dynamically generates adversarial samples tailored to the detector's current learning state. Central to our approach is integrating reinforcement learning (RL) and causal inference. An RL agent dynamically selects augmentation actions based on detector performance to efficiently explore the vast augmentation space, adapting to increasingly challenging forgeries. Simultaneously, the agent introduces action space variations to generate heterogeneous forgery patterns, guided by causal inference to mitigate spurious correlations-suppressing task-irrelevant biases and focusing on causally invariant features. This integration ensures robust generalization by decoupling synthetic augmentation patterns from the model's learned representations. Extensive experiments show our method significantly improves detector generalizability, outperforming SOTA methods across multiple cross-domain datasets.

深度伪造强化学习数据增强泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。