arXiv:2603.05095cs.CVcs.AI2026-03中稿 · CVPR

用弱监督实现高精度视频伪造定位,解决标注少与定位不准的矛盾。

GEM-TFL: Bridging Weak and Full Supervision for Forgery Localization through EM-Guided Decomposition and Temporal Refinement

  • 通过EM优化将视频级标签转为多维隐属性,增强弱监督能力。
  • 无需训练的时序一致性精修,使预测结果更平滑连续。
  • 图结构建模片段间关系,全局优化伪造置信度,适合安全检测场景。

时序伪造定位(TFL)旨在精确识别视频或音频流中被篡改的片段,为多媒体取证与安全提供可解释证据。现有方法多依赖密集帧级标签的全监督训练,而弱监督TFL(WS-TFL)仅使用二值视频级标签,降低标注成本。然而当前方法存在训练与推理目标不一致、二值标签监督有限、非可微top-k聚合导致梯度阻塞、以及缺乏对提案间关系的显式建模等问题。为此,我们提出GEM-TFL(基于图的EM驱动时序伪造定位),一种两阶段分类-回归框架,有效弥合训练与推理间的监督差距。在此基础上:(1) 通过基于EM的优化过程,将二值标签重构为多维隐属性,强化弱监督;(2) 引入无需训练的时序一致性精修模块,重校准帧级预测以获得更平滑的时序动态;(3) 设计基于图的提案精修模块,建模提案间的时序-语义关系,实现全局一致的置信度估计。在基准数据集上的大量实验表明,GEM-TFL实现了更准确、鲁棒的时序伪造定位,显著缩小了与全监督方法的差距。

原文摘要 · Abstract (English)

Temporal Forgery Localization (TFL) aims to precisely identify manipulated segments within videos or audio streams, providing interpretable evidence for multimedia forensics and security. While most existing TFL methods rely on dense frame-level labels in a fully supervised manner, Weakly Supervised TFL (WS-TFL) reduces labeling cost by learning only from binary video-level labels. However, current WS-TFL approaches suffer from mismatched training and inference objectives, limited supervision from binary labels, gradient blockage caused by non-differentiable top-k aggregation, and the absence of explicit modeling of inter-proposal relationships. To address these issues, we propose GEM-TFL (Graph-based EM-powered Temporal Forgery Localization), a two-phase classification-regression framework that effectively bridges the supervision gap between training and inference. Built upon this foundation, (1) we enhance weak supervision by reformulating binary labels into multi-dimensional latent attributes through an EM-based optimization process; (2) we introduce a training-free temporal consistency refinement that realigns frame-level predictions for smoother temporal dynamics; and (3) we design a graph-based proposal refinement module that models temporal-semantic relationships among proposals for globally consistent confidence estimation. Extensive experiments on benchmark datasets demonstrate that GEM-TFL achieves more accurate and robust temporal forgery localization, substantially narrowing the gap with fully supervised methods.

伪造定位弱监督时序建模图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。