arXiv:2605.05895cs.CVcs.AI2026-05

用脉冲神经网络检测生成视频,发现真假视频在时间动态上有隐藏差异。

Detecting AI-Generated Videos with Spiking Neural Networks

论文配图:Detecting AI-Generated Videos with Spiking Neural Networks
图 1 · 摘自论文原文
  • 通过脉冲神经网络捕捉帧间残差的稀疏事件信号,识别生成视频的时间异常
  • 在跨生成器测试中达到93.14%平均准确率,优于主流神经网络方法
  • 适合需要高泛化能力的视频真实性检测场景

现代AI生成视频在单帧上高度逼真,帧间动态成为主要检测线索。现有检测器通常采用全序列输入通用时序主干、提取固定视频级描述符或对比语义特征与真实视频统计的方法,但在跨生成器评估中性能显著下降,因不同生成器的伪影类型和时间尺度各异。在带字幕配对的基准GenVidBench上,我们发现两个未被共同利用的特征:生成视频在像素级帧间残差上更平滑,且语义特征空间轨迹更紧凑,表明在两个层面均存在时间平滑性差距。进一步观察到,当原始视频输入脉冲神经网络(SNNs)时,假视频主要在物体和运动边界处引发脉冲活动,而真实视频则无此现象,说明SNN对边缘处的时间伪影敏感。这些线索具有稀疏性、异步性和变化时刻集中性,使SNN天然适配该任务——其事件驱动、稀疏激活机制与残差信号结构高度契合,而密集型ANN主干则不具此优势。基于此,我们提出MAST,结合脉冲驱动的时序分支与冻结的语义编码器,实现跨生成器泛化。在GenVideo基准上,MAST在严格跨生成器评估下对10个未见生成器的平均准确率达93.14%,表现匹配或超越最强的ANN基检测器,证明了SNN在生成视频检测中的实际应用价值。

原文摘要 · Abstract (English)

Modern AI-generated videos are photorealistic at the single-frame level, leaving inter-frame dynamics as the main remaining axis for detection. Existing detectors typically handle this temporal evidence in three ways: feeding the full frame sequence to a generic temporal backbone, reducing one dominant temporal cue to fixed video-level descriptors, or comparing temporal features to real-video statistics through a detection metric. These strategies degrade sharply under cross-generator evaluation, where artifact type and timescale vary across generators. On caption-paired benchmark, GenVidBench, we identify two signatures that prior detectors do not jointly exploit: AI-generated videos exhibit smoother frame-to-frame temporal residuals at the pixel level, and more compact trajectories in the semantic feature space, indicating a temporal smoothness gap at both levels. We further observe that, when raw video is fed into a Spiking Neural Networks (SNNs), fake clips elicit firing predominantly at object and motion boundaries, unlike real clips, suggesting that the SNN responds to temporal artifacts localized at edges. These cues are sparse, asynchronous, and concentrated at moments of change, which makes SNNs a natural choice for this task: their event-driven, sparsely-activated dynamics align with the structure of the residual signal in a way that dense ANN backbones do not. Building on this observation, we propose MAST, a detector that processes multi-channel temporal residuals with a spike-driven temporal branch alongside a frozen semantic encoder for cross-generator generalization. On the GenVideo benchmark, MAST achieves 93.14\% mean accuracy across 10 unseen generators under strict cross-generator evaluation, matching or surpassing the strongest ANN-based detectors and demonstrating the practical applicability of SNNs to AI-generated video detection.

视频检测脉冲神经网络生成内容

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。