arXiv:2510.08073cs.CVcs.LG2025-10NeurIPS被引 24

基于物理规律设计新方法,精准识别AI生成视频中的异常动态。

Physics-Driven Spatiotemporal Modeling for AI-Generated Video Detection

  • 用空间概率梯度与时间密度变化的比值量化视频动态异常。
  • 在真实视频上检测准确率提升16%召回率和10.75%F1分数。
  • 适合需要高精度鉴别AI视频的研究者或内容安全团队使用。

AI生成视频已达到近乎完美的视觉真实感(如Sora),亟需可靠的检测机制。然而,检测面临建模高维时空动态及识别违背物理规律的细微异常的挑战。本文提出首个基于概率流守恒原理的物理驱动型检测范式。我们设计一种称为归一化时空梯度(NSG)的统计量,通过空间概率梯度与时间密度变化之比,显式捕捉自然视频动态的偏离。利用预训练扩散模型,我们无需复杂运动分解,仅通过空间梯度近似与运动感知的时间建模,构建了NSG估计器。在此基础上,提出基于NSG的视频检测方法(NSG-VD),以测试视频与真实视频间NSG特征的最大均值差异(MMD)作为检测指标。最后,推导出真实与生成视频间NSG特征距离的上界,证明生成视频因分布偏移导致差异被放大。大量实验表明,NSG-VD在召回率上优于最先进基线16.00%,在F1分数上提升10.75%,验证了其优越性能。源代码已公开于https://github.com/ZSHsh98/NSG-VD。

原文摘要 · Abstract (English)

AI-generated videos have achieved near-perfect visual realism (e.g., Sora), urgently necessitating reliable detection mechanisms. However, detecting such videos faces significant challenges in modeling high-dimensional spatiotemporal dynamics and identifying subtle anomalies that violate physical laws. In this paper, we propose the first physics-driven AI-generated video detection paradigm based on probability flow conservation principles. Specifically, we propose a statistic called Normalized Spatiotemporal Gradient (NSG), which quantifies the ratio of spatial probability gradients to temporal density changes, explicitly capturing deviations from natural video dynamics. Leveraging pre-trained diffusion models, we develop an NSG estimator through spatial gradients approximation and motion-aware temporal modeling without complex motion decomposition while preserving physical constraints. Building on this, we propose an NSG-based video detection method (NSG-VD) that computes the Maximum Mean Discrepancy (MMD) between NSG features of the test and real videos as a detection metric. Last, we derive an upper bound of NSG feature distances between real and generated videos, proving that generated videos exhibit amplified discrepancies due to distributional shifts. Extensive experiments confirm that NSG-VD outperforms state-of-the-art baselines by 16.00% in Recall and 10.75% in F1-Score, validating the superior performance of NSG-VD. The source code is available at https://github.com/ZSHsh98/NSG-VD.

视频检测物理约束扩散模型AI伪造

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。