发现视频伪造检测器中隐藏的稀疏鉴别知识,可高效提取用于检测。
V-FIND: Revealing the Intrinsic Forgery Knowledge Encoded in Video Forgery Detectors

- 通过定位关键层和锚定神经元,挖掘检测器内的稀疏鉴别特征。
- 仅用轻量线性分类器,在多个外部数据集上达到强检测性能。
- 揭示检测器内在鉴别能力,适合模型压缩与可解释性研究。
随着生成视频日益逼真,可靠的视频伪造检测愈发重要。现有方法通常将检测器视为黑箱进行优化,而其内部潜藏的伪造判别知识仍被忽视。我们提出,是否可通过发掘并激活检测器中的稀疏取证知识来实现检测,而非依赖资源密集的全模型重训练。研究发现,伪造判别知识并非均匀分布于整个表示空间,而是集中于少数功能专一的神经元。基于此,我们提出视频伪造内在神经元发现框架(V-FIND):首先定位真实与伪造视频差异显著的关键层,再识别持续携带伪造判别信号的潜在锚定神经元,并将其组织为紧凑的取证子空间。在保持原始骨干网络冻结、仅训练轻量线性分类器的情况下,该子空间在多个外部生成视频基准测试中仍表现强劲。进一步的神经元干预实验直接证明了所发现神经元的功能特异性。结果表明,视频伪造检测器内蕴含着稀疏、可提取且可复用的判别知识,为理解与利用其内在取证能力提供了新视角。
原文摘要 · Abstract (English)
As generated videos become increasingly realistic, reliable video forgery detection is increasingly important. Existing studies typically optimize and use video forgery detectors as black boxes, while the latent forgery-discriminative knowledge inside them remains largely unexplored. Instead of continuing to rely on resource-intensive full-model retraining to steadily improve detection performance, we ask whether video forgery detection can also be achieved by uncovering and activating sparse forensic knowledge within the detector. We find that forgery-discriminative knowledge is not uniformly distributed across the full representation space, but is concentrated in a sparse set of functionally specialized neurons. Based on this insight, we propose a video forgery-intrinsic neuron discovery (V-FIND) framework. V-FIND first localizes critical layers that exhibit pronounced discrepancies between real and forged videos, and then identifies latent anchor neurons that consistently carry forgery-discriminative signals, organizing them into a compact forensic subspace. With the original backbone frozen and only a lightweight linear classifier trained, this subspace still delivers strong detection performance across multiple external benchmarks for generated videos. Further neuron intervention experiments provide direct evidence for the functional specificity of the discovered neurons. Overall, these results suggest that video forgery detectors contain sparse, extractable, and reusable forgery-discriminative knowledge, offering a new perspective on understanding and exploiting their intrinsic forensic capability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。