arXiv:2510.16556cs.CV2025-10被引 3

首个真实政治深伪视频检测基准,揭示现有模型在实际场景中效果不佳。

Fit for Purpose? Deepfake Detection in the Real World

  • 基于真实社交媒体政治深伪视频库构建评估基准
  • 主流检测工具对真实世界深伪内容泛化能力差,视频类尤其脆弱
  • 呼吁开发融合政治语境的检测框架,适配真实舆论环境

生成对抗网络、扩散模型和多模态大语言模型的发展,使合成媒体的制作与传播变得轻而易举,加剧了虚假信息风险,特别是扭曲事实的政治类深伪视频,严重威胁公众对政治机构的信任。为此,政府、研究机构和产业界大力推动深伪检测技术。然而,现有模型大多在受控的合成数据集上训练和验证,难以泛化到社交媒体上真实传播的政治深伪视频。本文首次基于自2018年以来在社交平台传播的真实政治深伪视频数据库(Political Deepfakes Incident Database)构建系统性评测基准,全面评估学术界、政府及产业界的前沿检测模型。结果发现:学术与政府模型表现相对较弱;付费检测工具虽优于开源模型,但所有检测器在真实政治深伪视频上均难以有效泛化,且对简单篡改高度敏感,尤其在视频领域。研究强调需建立融合政治语境的深伪检测框架,以更好保障公共安全。

原文摘要 · Abstract (English)

The rapid proliferation of AI-generated content, driven by advances in generative adversarial networks, diffusion models, and multimodal large language models, has made the creation and dissemination of synthetic media effortless, heightening the risks of misinformation, particularly political deepfakes that distort truth and undermine trust in political institutions. In turn, governments, research institutions, and industry have strongly promoted deepfake detection initiatives as solutions. Yet, most existing models are trained and validated on synthetic, laboratory-controlled datasets, limiting their generalizability to the kinds of real-world political deepfakes circulating on social platforms that affect the public. In this work, we introduce the first systematic benchmark based on the Political Deepfakes Incident Database, a curated collection of real-world political deepfakes shared on social media since 2018. Our study includes a systematic evaluation of state-of-the-art deepfake detectors across academia, government, and industry. We find that the detectors from academia and government perform relatively poorly. While paid detection tools achieve relatively higher performance than free-access models, all evaluated detectors struggle to generalize effectively to authentic political deepfakes, and are vulnerable to simple manipulations, especially in the video domain. Results urge the need for politically contextualized deepfake detection frameworks to better safeguard the public in real-world settings.

深伪检测政治安全真实世界视频伪造

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。