arXiv:2507.19924cs.CV2025-07ICCV被引 6

区分伪造视频中的人体空间、外观和运动异常,提升检测可信度。

HumanSAM: Classifying Human-centric Forgery Videos in Human Spatial, Appearance, and Motion Anomaly

  • 融合双分支视频理解与深度信息生成人体伪造特征
  • 在自建数据集上多分类准确率超越现有方法
  • 适合需要细粒度伪造类型识别的安防与内容审核场景

由生成模型合成的人体相关视频,尤其是模拟真实人体动作的视频,对信息安全与真实性构成重大威胁。尽管二分类伪造检测已取得进展,但对伪造类型的细粒度理解不足,影响了实际应用中的可靠性与可解释性。为此,我们提出HumanSAM框架,旨在将人体类伪造视频分类为三类常见缺陷:空间异常、外观异常与运动异常。通过融合视频理解与空间深度信息,捕捉几何、语义及时空一致性特征,并引入三种先验得分,采用基于排序的置信度增强策略训练更鲁棒的表示。我们构建了首个公开基准数据集HFV,对各类伪造视频进行半自动标注。实验表明,HumanSAM在二分类与多分类任务上均优于当前最优方法。

原文摘要 · Abstract (English)

Numerous synthesized videos from generative models, especially human-centric ones that simulate realistic human actions, pose significant threats to human information security and authenticity. While progress has been made in binary forgery video detection, the lack of fine-grained understanding of forgery types raises concerns regarding both reliability and interpretability, which are critical for real-world applications. To address this limitation, we propose HumanSAM, a new framework that builds upon the fundamental challenges of video generation models. Specifically, HumanSAM aims to classify human-centric forgeries into three distinct types of artifacts commonly observed in generated content: spatial, appearance, and motion anomaly. To better capture the features of geometry, semantics and spatiotemporal consistency, we propose to generate the human forgery representation by fusing two branches of video understanding and spatial depth. We also adopt a rank-based confidence enhancement strategy during the training process to learn more robust representation by introducing three prior scores. For training and evaluation, we construct the first public benchmark, the Human-centric Forgery Video (HFV) dataset, with all types of forgeries carefully annotated semi-automatically. In our experiments, HumanSAM yields promising results in comparison with state-of-the-art methods, both in binary and multi-class forgery classification.

伪造检测视频安全细粒度分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。