构建开放数据集与平台,提升真实世界深度伪造检测能力
OpenFake: An Open Dataset and Platform Toward Real-World Deepfake Detection
- 构建包含近400万张图像的OpenFake数据集,涵盖真实与高仿真合成图像
- 基于该数据集训练的检测器在真实社交平台测试中准确率显著优于现有模型
- 支持持续更新的众包对抗平台,可动态引入新型难例以保持检测前沿性
深度伪造作为由先进AI技术生成的合成媒体,正对信息真实性构成日益严峻的威胁,尤其在政治敏感场景中。我们的人类感知研究表明,现代生成模型产生的内容往往与真实图像难以区分。然而,现有检测基准多依赖过时生成器或范围狭窄的数据集(如仅单人脸图像),难以反映真实环境。为此,我们提出OpenFake,一个面向真实政治语境、专为现代高保真生成模型设计的大规模数据集,并配套创新的众包对抗平台,可持续集成新挑战样本。OpenFake包含近四百万张图像:三百万张真实图像配以描述性标题,近一百万张来自顶尖私有及开源生成模型的合成图像。基于此数据集训练的检测器在分布内表现接近完美,对未见生成器具备强泛化能力,在精选的真实社交媒体测试集上也表现出高准确率,显著优于现有数据集训练的模型。整体表明,高质量且持续更新的基准能有效支撑真实场景下的自动化深度伪造检测。
原文摘要 · Abstract (English)
Deepfakes, synthetic media created using advanced AI techniques, pose a growing threat to information integrity, particularly in politically sensitive contexts. This challenge is amplified by the increasing realism of modern generative models, which our human perception study confirms are often indistinguishable from real images. Yet, existing deepfake detection benchmarks rely on outdated generators or narrowly scoped datasets (e.g., single-face imagery), limiting their utility for real-world detection. To address these gaps, we present OpenFake, a large politically grounded dataset specifically crafted for benchmarking against modern generative models with high realism, and designed to remain extensible through an innovative crowdsourced adversarial platform that continually integrates new hard examples. OpenFake comprises nearly four million total images: three million real images paired with descriptive captions and almost one million synthetic counterparts from state-of-the-art proprietary and open-source models. Detectors trained on OpenFake achieve near-perfect in-distribution performance, strong generalization to unseen generators, and high accuracy on a curated in-the-wild social media test set, significantly outperforming models trained on existing datasets. Overall, we demonstrate that with high-quality and continually updated benchmarks, automatic deepfake detection is both feasible and effective in real-world settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。