利用重建误差与语义融合,提升AI生成视频检测精度。
ReConFuse: Reconstruction-Error Guided Semantic Fusion for AI-Generated Video Detection

- 通过预训练模型重构视频,提取帧级重建误差作为判别线索。
- 在多个生成器上实现90%以上准确率,且对新模型有强泛化能力。
- 适合需要高鲁棒性视频真伪检测的媒体安全与内容审核场景。
AI生成视频日益逼真,引发虚假信息、内容真实性和媒体信任危机。可靠的AI生成视频检测对多媒体取证至关重要,但因需捕捉空间伪影、时间动态并适应不断演进的生成模型而面临挑战。本文探索以重建误差作为判别性取证线索。通过使用预训练的WF-VAE重构输入视频,发现真实与生成视频在帧级重建误差模式上存在可区分差异,表明重建误差能揭示其分布差异。然而,将基于重建的图像检测方法扩展至视频并不简单,因为视频重建误差在帧间具有时间关联性,需结合语义上下文进行有效解读。为此,我们提出ReConFuse:一种基于重建引导的语义融合框架,用于视频级AI生成视频检测。ReConFuse从WF-VAE重构视频中提取重建误差线索,将其与多帧语义特征对齐,并采用基于Mamba的模块建模时间演化,实现视频级分类。在多个生成器和评估设置下的实验验证了ReConFuse的有效性与强泛化能力。
原文摘要 · Abstract (English)
AI-generated videos are becoming increasingly realistic, raising serious concerns about misinformation, content authenticity, and media trust. Reliable AI-generated video detection is therefore essential for multimedia forensics, yet remains challenging due to the need to capture spatial artifacts, temporal dynamics, and generalize to evolving generative models. In this paper, we explore reconstruction error as a discriminative forensic cue for AI-generated video detection. By reconstructing input videos with a pretrained WF-VAE, we observe that real and generated videos exhibit distinguishable frame-wise reconstruction error patterns, suggesting that reconstruction errors can reveal their distributional discrepancies. However, extending reconstruction-based image detection to videos is non-trivial, since video reconstruction errors are temporally organized across frames and require semantic context for effective interpretation. To address these challenges, we propose ReConFuse, a reconstruction-guided semantic fusion framework for video-level AI-generated video detection. ReConFuse extracts reconstruction error cues from WF-VAE reconstructed videos, aligns them with multi-frame semantic features, and uses a Mamba-based module to model temporal evolution for video-level classification. Experiments across multiple generators and evaluation settings demonstrate the effectiveness and strong generalization ability of ReConFuse.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。