评测6000个视频,发现合成视频检测在抗后处理上仍脆弱。
Advancing Reliable Synthetic Video Detection: Insights from the SAFE Challenge

- 设计双任务挑战:识别多种生成模型和后处理过的合成视频。
- 13种生成模型、21个真实来源,共6000个视频样本,覆盖20小时数据。
- 检测模型跨生成器泛化有进步,但对压缩、模糊等后处理仍易失效。
生成视频技术的普及加剧了对可靠合成媒体检测方法的需求。为此,我们组织了「SAFE:合成视频检测挑战赛」,于ICCV 2025期间与APAIGA研讨会同期举行。挑战赛邀请参与者在完全盲测条件下开发并评估算法,以区分真实与合成视频,共收到12支团队的600余份提交。比赛在Hugging Face平台进行,包含两项主要任务:(1)检测由多种先进生成模型产生的合成视频内容;(2)检测经过常见后处理操作(如重缩放、再压缩、运动模糊等)后的合成内容。数据集涵盖13种现代高质量合成视频模型,生成内容匹配来自21个多样化且具挑战性的真实视频源,总计20小时、6000个视频样本。本文详述了挑战的设计、数据构建、评估方法及结果,揭示了当前合成视频检测方法在泛化性与鲁棒性方面的进展与局限。研究发现,跨生成器泛化能力已有明显提升,但对后处理伪影仍存在持续漏洞。
原文摘要 · Abstract (English)
The proliferation of generative video technologies has intensified the need for reliable methods to detect and characterize synthetic media. To address this challenge, we organized the \href{https://safe-video-2025.dsri.org}{SAFE: Synthetic Video Detection Challenge}, co-located with the \textit{Authenticity and Provenance in the Age of Generative AI (APAI) Workshop }at ICCV 2025. The competition invited participants to develop and evaluate algorithms capable of distinguishing real from synthetic videos under fully blind evaluation conditions with over 600 submissions from 12 teams over a 90 day span. Hosted on the Hugging Face platform, the challenge comprised two primary tasks: (1) detection of synthetic video content generated by diverse state-of-the-art models, and (2) detection of synthetic content following common post-processing operations such as resizing, re-compression, motion blur and others. The challenge data consisted of 13 modern high quality synthetic video models with generated content matched to real videos from 21 diverse and challenge sources, all adding up to 20 hours of 6,000 video samples. This paper describes the challenge design, dataset construction, evaluation methodology, and outcomes, offering insights into the generalization and robustness of contemporary synthetic video detection methods. Our findings highlight measurable progress in cross-generator generalization but also persistent vulnerabilities to post-processing artifacts. https://safe-video-2025.dsri.org
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。