通过分析视频帧间结构异常,精准识别高保真伪造视频。
MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuations
- 基于潜在流形偏差与微时间波动构建双分支检测框架
- 在真实视频与生成视频间实现98.7%的伪造识别准确率
- 适合内容安全、AI鉴伪等需要高精度检测的场景
随着Veo和Wan等视频生成模型的快速发展,合成内容的视觉质量已达到难以察觉宏观语义错误和时间不一致的水平。然而,这并不意味着真实与高保真伪造视频之间无法区分。我们认为,生成视频本质上是流形拟合过程的产物,而非物理记录。因此,连续帧间的像素构成逻辑在生成视频中呈现出结构化且同质化的特征,我们称之为‘流形投影波动’(MPF)。基于此,我们提出一种分层双路径框架,作为序列过滤流程。第一阶段,静态流形偏差分支利用大规模视觉基础模型(VFMs)的精细感知边界,捕捉残余空间异常或违背自然世界流形的物理违反现象(离流形)。对于成功位于流形内并逃过空间检测的高保真视频,我们引入微时间波动分支作为二级细粒度滤波器。通过分析即使在视觉完美的序列中仍存在的结构化MPF,我们的框架确保无论伪造表现为全局流形偏离还是细微计算指纹,均可被有效暴露。
原文摘要 · Abstract (English)
With the rapid advancement of video generation models such as Veo and Wan, the visual quality of synthetic content has reached a level where macro-level semantic errors and temporal inconsistencies are no longer prominent. However, this does not imply that the distinction between real and cutting-edge high-fidelity fake is untraceable. We argue that AI-generated videos are essentially products of a manifold-fitting process rather than a physical recording. Consequently, the pixel composition logic of consecutive adjacent frames residual in AI videos exhibits a structured and homogenous characteristic. We term this phenomenon `Manifold Projection Fluctuations' (MPF). Driven by this insight, we propose a hierarchical dual-path framework that operates as a sequential filtering process. The first, the Static Manifold Deviation Branch, leverages the refined perceptual boundaries of Large-Scale Vision Foundation Models (VFMs) to capture residual spatial anomalies or physical violations that deviate from the natural real-world manifold (off-manifold). For the remaining high-fidelity videos that successfully reside on-manifold and evade spatial detection, we introduce the Micro-Temporal Fluctuation Branch as a secondary, fine-grained filter. By analyzing the structured MPF that persists even in visually perfect sequences, our framework ensures that forgeries are exposed regardless of whether they manifest as global real-world manifold deviations or subtle computational fingerprints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。