提出多智能体框架,让检测模型自适应新伪造内容并保持高鲁棒性。
Adaptive Meta-Learning for Robust Deepfake Detection: A Multi-Agent Framework to Data Drift and Model Generalization
- 用自适应样本生成和一致性正则化提升模型泛化能力
- 在多个数据集上超越现有模型,保持稳定性能
- 适合需要持续更新的反深度伪造系统开发者
人工智能,尤其是生成式AI的突破性进展,为内容创作带来巨大可能,也导致了广泛的信息误导与虚假内容传播。日益逼真的深度伪造技术引发了对隐私侵犯、身份盗用的担忧,并在社会、商业层面造成声誉损害和财务损失。尽管已有大量深度伪造检测模型,但它们普遍存在对未见场景和跨域伪造内容泛化能力不足的问题,且对微小不可察觉的扰动缺乏鲁棒性。大多数先进检测器基于静态数据集训练,难以应对新兴伪造趋势。本文提出一种对抗性元学习算法,结合任务特异性自适应样本合成与一致性正则化,在优化阶段提升分类器的稳健性与泛化能力。同时引入分层多智能体检索增强生成流程,配备样本合成模块,动态生成定制化深度伪造样本以适应新数据趋势。进一步构建融合元学习与多智能体流程的框架,实现泛化、鲁棒性与可适应性的整体提升。实验表明,该模型在多个数据集上表现一致优异,优于对比模型。
原文摘要 · Abstract (English)
Pioneering advancements in artificial intelligence, especially in genAI, have enabled significant possibilities for content creation, but also led to widespread misinformation and false content. The growing sophistication and realism of deepfakes is raising concerns about privacy invasion, identity theft, and has societal, business impacts, including reputational damage and financial loss. Many deepfake detectors have been developed to tackle this problem. Nevertheless, as for every AI model, the deepfake detectors face the wrath of lack of considerable generalization to unseen scenarios and cross-domain deepfakes. Besides, adversarial robustness is another critical challenge, as detectors drastically underperform to the slightest imperceptible change. Most state-of-the-art detectors are trained on static datasets and lack the ability to adapt to emerging deepfake attack trends. These three crucial challenges though hold paramount importance for reliability in practise, particularly in the deepfake domain, are also the problems with any other AI application. This paper proposes an adversarial meta-learning algorithm using task-specific adaptive sample synthesis and consistency regularization, in a refinement phase. By focussing on the classifier's strengths and weaknesses, it boosts both robustness and generalization of the model. Additionally, the paper introduces a hierarchical multi-agent retrieval-augmented generation workflow with a sample synthesis module to dynamically adapt the model to new data trends by generating custom deepfake samples. The paper further presents a framework integrating the meta-learning algorithm with the hierarchical multi-agent workflow, offering a holistic solution for enhancing generalization, robustness, and adaptability. Experimental results demonstrate the model's consistent performance across various datasets, outperforming the models in comparison.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。