深伪检测研究方向与真实威胁脱节,应转向更紧迫的私密影像滥用等新风险。
The Deepfakes We Missed: We Built Detectors for a Threat That Didn't Arrive

- 指出当前检测技术仍聚焦2017-2019年预测的名人换脸骗局
- 2022-2026年真实事件显示主要威胁为私密影像滥用和语音克隆诈骗
- 呼吁调整研究重心,关注实际增长的新型危害,尤其适合政策制定者与安全研究者
近十年机器学习领域的深伪检测研究始终围绕2017–2019年提出的威胁模型展开,聚焦公众人物的换脸与口型同步视频伪造,旨在应对大规模虚假信息与视频证据欺诈。本文认为该预测的危机并未在2024年全球信息环境中出现,而真正浮现的威胁已截然不同:主要包括同辈生成的非自愿亲密影像(NCII)、针对家庭与金融从业者的语音克隆诈骗电话,以及情感操纵类欺诈。尽管已有广泛准备,但大规模公众人物深伪灾难未发生。与此同时,研究资源、基准数据集与检测方法仍集中于过时的威胁模型。本文核心观点是:当前研究与现实威胁间的错位已成为真实防护的首要瓶颈,而非模型能力不足。通过实证分析研究投入与危害分布,识别出结构性失衡原因,并提出三个面向新兴威胁的具体技术研究方向。
原文摘要 · Abstract (English)
Nearly a decade of Machine Learning (ML) research on deepfake detection has been organized around a threat model inherited from 2017--2019, revolving around face-swap and talking-head manipulation of public figures, motivated by concerns about large-scale misinformation and video-evidence fraud. This position paper argues that the threat the field prepared for did not arrive, and the threats that did arrive are substantially different. An accounting of deepfake incidents in 2022--2026 shows that the dominant observed harms are peer-generated Non-Consensual Intimate Imagery (NCII), voice-clone scam calls targeting families and finance workers, and emotional-manipulation fraud. The predicted large-scale public-figure deepfake catastrophe did not materialize during the 2024 global information environment despite extensive preparation. Meanwhile, research effort, benchmarks, and detection methods remain concentrated on the inherited threat model. The central claim of this paper is that this misalignment is now the dominant bottleneck on real-world deepfake defense, not model capability. We argue the ML research community should substantially rebalance its research agenda toward the harm categories that are actually growing. We support this position with empirical accounting of research effort and harm distribution, identify the structural reasons the misalignment persists, and outline three concrete technical research agendas for the under-defended harm categories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。