用物理稳定性分析检测深度伪造,突破传统静态识别局限。
Detecting Deepfakes via Hamiltonian Dynamics

- 将图像潜在空间建模为能量表面,通过动态响应判断真假
- 在跨数据集测试中优于现有最优方法,稳定性能更优
- 适合数字取证、AI安全领域研究者参考
随着生成式AI模型快速发展,深度伪造检测需持续更新以应对新型合成痕迹。为此,我们提出新视角:从静态模式识别转向动力学稳定性分析。受物理先验启发,自然图像作为耗散过程产物,倾向于处于低能稳定平衡态;而生成模型仅追求统计相似性,未显式约束几何平滑性,导致深度伪造更可能位于高能不稳定状态。为此,我们提出哈密顿作用异常检测(HAAD),包含三项贡献:首先,将图像潜在流形建模为势能面,真实图像应产生类似盆地的低能响应,虚假图像则引发高势能、高梯度响应;其次,采用哈密顿动力学作为稳定性探针,从静止释放潜在状态,稳定区域样本轨迹受限,高梯度样本产生更大响应;第三,通过哈密顿作用与能量耗散两个轨迹统计量量化动态行为。大量实验表明,HAAD在具有挑战性的跨数据集迁移基准上优于当前最优基线,验证了基于物理稳定性的先验在数字取证中的有效性。
原文摘要 · Abstract (English)
Driven by the rapid development of generative AI models, deepfake detectors are compelled to undergo periodic recalibration to capture newly developed synthetic artifacts. To break this cycle, we propose a new perspective on deepfake detection: moving from static pattern recognition to dynamical stability analysis. Specifically, our approach is motivated by physics-inspired priors: we hypothesize that natural images, as products of dissipative physical processes, tend to settle near stable, low-energy equilibria. In contrast, generative models optimize for statistical similarity to real images but do not explicitly enforce structural constraints such as geometric smoothness, leaving deepfakes more likely to occupy unstable, high-energy states. To operationalize this, we introduce Hamiltonian Action Anomaly Detection (HAAD), comprising three contributions: \textbf{i)} We model the image latent manifold as a potential energy surface. Under this hypothesis, real images are expected to produce basin-like low-energy responses, whereas fake images are more likely to induce high-potential, high-gradient responses. \textbf{ii)} We employ Hamiltonian-inspired dynamics as a stability probe. By releasing latent states from rest, samples near stable regions remain bounded, while high-gradient samples produce larger trajectory responses. \textbf{iii)} We quantify these dynamic behaviors through two trajectory statistics, \ie, Hamiltonian action and energy dissipation. Extensive experiments show that HAAD outperforms evaluated state-of-the-art baselines on challenging cross-dataset transfer benchmarks, supporting a physics-inspired stability prior for digital forensics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。