通过局部与全局联合建模,提升真实场景下深度伪造检测的鲁棒性。
LOGER: Local--Global Ensemble for Robust Deepfake Detection in the Wild
- 分设局部与全局分支,分别捕捉细微篡改痕迹和整体异常模式。
- 在多个公开数据集上达到领先性能,对多种伪造手法和退化条件均有效。
- 适合需要高鲁棒性检测的安防、内容审核等实际应用场景。
真实场景中的鲁棒深度伪造检测仍面临挑战,源于不断演变的篡改技术及不可控的现实退化。伪造痕迹存在于两个互补层面:全局层面的语义与统计异常需整体图像理解,局部层面的篡改痕迹集中于被篡改区域,易被全局平均稀释。由于单一主干网络或输入尺度难以同时覆盖两层,本文提出LOGER(LOcal--Global Ensemble),一种用于鲁棒深度伪造检测的框架。全局分支采用多分辨率异构视觉基础模型主干,融合多样视觉先验捕捉整体异常;局部分支采用基于Multiple Instance Learning的top-k聚合策略,仅选择最可疑区域进行特征聚合,缓解正常区域主导导致的证据稀释问题;并在聚合图像与单个补丁层面施加双级监督,保持局部响应的判别力。由于两分支在粒度与主干上差异显著,其错误具有高度去相关性,可通过逻辑空间融合实现更鲁棒预测。LOGER在NTIRE 2026鲁棒深度伪造检测挑战赛中获得第二名,进一步在多个公共基准测试中验证了其在多样化篡改方法和真实退化条件下的强鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Robust deepfake detection in the wild remains challenging due to the ever-growing variety of manipulation techniques and uncontrolled real-world degradations. Forensic cues for deepfake detection reside at two complementary levels: global-level anomalies in semantics and statistics that require holistic image understanding, and local-level forgery traces concentrated in manipulated regions that are easily diluted by global averaging. Since no single backbone or input scale can effectively cover both levels, we propose LOGER, a LOcal--Global Ensemble framework for Robust deepfake detection. The global branch employs heterogeneous vision foundation model backbones at multiple resolutions to capture holistic anomalies with diverse visual priors. The local branch performs patch-level modeling with a Multiple Instance Learning top-$k$ aggregation strategy that selectively pools only the most suspicious regions, mitigating evidence dilution caused by the dominance of normal patches; dual-level supervision at both the aggregated image level and individual patch level keeps local responses discriminative. Because the two branches differ in both granularity and backbone, their errors are largely decorrelated, a property that logit-space fusion exploits for more robust prediction. LOGER achieves 2nd place in the NTIRE 2026 Robust Deepfake Detection Challenge, and further evaluation on multiple public benchmarks confirms its strong robustness and generalization across diverse manipulation methods and real-world degradation conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。