提出PLADA框架,有效应对社交网络中压缩图像的伪造检测难题。
Pay Less Attention to Deceptive Artifacts: Robust Detection of Compressed Deepfakes on Online Social Networks
- 通过双阶段注意力机制消除压缩带来的块效应干扰
- 在26个数据集上超越现有方法,即使配对数据有限也表现优异
- 适合关注真实场景下深度伪造检测的研究者与安全工程师
随着生成对抗网络(GANs)和扩散模型(DMs)的快速发展,人工智能生成的图像(即“深度伪造”)已几乎无法与真实图像区分。这些图像广泛传播于在线社交网络(OSNs),引发滥用担忧。现有检测方法忽略社交网络中压缩引入的“块效应”,仅关注原始图像,难以应对现实场景。为此,我们提出PLADA(Pay Less Attention to Deceptive Artifacts)框架,解决缺乏配对数据及压缩图像利用效率低的问题。PLADA包含两个核心模块:块效应消除器(B2E)采用双阶段注意力机制处理块效应;开放数据聚合(ODA)可同时处理有配对和无配对数据以提升检测性能。在26个数据集上的大量实验表明,PLADA在社交网络深度伪造检测中表现出色,优于当前最优方法,即使在配对数据有限且存在压缩的情况下依然有效。更重要的是,本工作首次将“块效应”确立为深度伪造检测的关键因素,为开放世界场景提供稳健解决方案。代码已开源:https://github.com/ManyiLee/PLADA。
原文摘要 · Abstract (English)
With the rapid advancement of deep learning, particularly through generative adversarial networks (GANs) and diffusion models (DMs), AI-generated images, or ``deepfakes", have become nearly indistinguishable from real ones. These images are widely shared across Online Social Networks (OSNs), raising concerns about their misuse. Existing deepfake detection methods overlook the ``block effects" introduced by compression in OSNs, which obscure deepfake artifacts, and primarily focus on raw images, rarely encountered in real-world scenarios. To address these challenges, we propose PLADA (Pay Less Attention to Deceptive Artifacts), a novel framework designed to tackle the lack of paired data and the ineffective use of compressed images. PLADA consists of two core modules: Block Effect Eraser (B2E), which uses a dual-stage attention mechanism to handle block effects, and Open Data Aggregation (ODA), which processes both paired and unpaired data to improve detection. Extensive experiments across 26 datasets demonstrate that PLADA achieves a remarkable balance in deepfake detection, outperforming SoTA methods in detecting deepfakes on OSNs, even with limited paired data and compression. More importantly, this work introduces the ``block effect" as a critical factor in deepfake detection, providing a robust solution for open-world scenarios. Our code is available at https://github.com/ManyiLee/PLADA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。