利用预训练视觉模型检测生成视频,无需额外训练即可达90%以上准确率。
Leveraging Pre-Trained Visual Models for AI-Generated Video Detection
- 用预训练模型提取特征,捕捉真实与生成视频的细微差异。
- 在1万条生成视频上测试,平均准确率超90%。
- 适合需要快速部署检测能力的研究者和安全团队。
生成式AI在视觉内容生成方面取得显著进展,使得生成内容与真实内容几乎无法区分,这给防范虚假信息、保护隐私和应对安全威胁带来了严峻挑战。尽管图像生成检测已取得进展,但现有视频检测方法仍主要集中于人脸深度伪造,难以应对更广泛的通用内容生成视频。为此,我们提出一种新方法,利用预训练视觉模型提取特征,这些特征来自在大量真实视觉数据上训练的模型,天然包含区分真实与生成视频的信号。通过直接使用这些特征,无需额外训练即可实现高检测性能;进一步在特征上训练一个简单线性分类器,可提升效果。我们在自建数据集VID-AID上验证了该方法,该数据集包含约10,000条由9种文本到视频模型生成的视频,以及4,000条真实视频,总时长超过7小时。评估结果显示,该方法平均检测准确率超过90%,证明其有效性。论文被接受后,我们将公开代码、预训练模型和数据集,以支持该领域持续研究。
原文摘要 · Abstract (English)
Recent advances in Generative AI (GenAI) have led to significant improvements in the quality of generated visual content. As AI-generated visual content becomes increasingly indistinguishable from real content, the challenge of detecting the generated content becomes critical in combating misinformation, ensuring privacy, and preventing security threats. Although there has been substantial progress in detecting AI-generated images, current methods for video detection are largely focused on deepfakes, which primarily involve human faces. However, the field of video generation has advanced beyond DeepFakes, creating an urgent need for methods capable of detecting AI-generated videos with generic content. To address this gap, we propose a novel approach that leverages pre-trained visual models to distinguish between real and generated videos. The features extracted from these pre-trained models, which have been trained on extensive real visual content, contain inherent signals that can help distinguish real from generated videos. Using these extracted features, we achieve high detection performance without requiring additional model training, and we further improve performance by training a simple linear classification layer on top of the extracted features. We validated our method on a dataset we compiled (VID-AID), which includes around 10,000 AI-generated videos produced by 9 different text-to-video models, along with 4,000 real videos, totaling over 7 hours of video content. Our evaluation shows that our approach achieves high detection accuracy, above 90% on average, underscoring its effectiveness. Upon acceptance, we plan to publicly release the code, the pre-trained models, and our dataset to support ongoing research in this critical area.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。