arXiv:2603.24057cs.CV2026-03

解决视觉伪造检测中因优化崩溃导致的泛化失效问题。

Beyond Semantic Priors: Mitigating Optimization Collapse for Generalizable Visual Forensics

  • 提出关键优化半径与梯度信噪比理论,揭示崩溃根源
  • 设计CoRIT模型,在跨域检测中达到顶尖泛化性能
  • 无需训练的三策略提升梯度保真度,适合实际部署

尽管基于视觉-语言模型(如CLIP)的通用深度伪造检测已成为主流,但其语义中心预训练方式难以捕捉超真实合成中的非语义痕迹。本文识别出一种称为优化崩溃的新失败模式:当扰动半径超过狭窄阈值时,使用锐度感知最小化(SAM)训练的检测器在非语义伪造上退化为随机猜测。为此,我们提出临界优化半径(COR)量化优化景观的几何稳定性,并用梯度信噪比(GSNR)衡量泛化潜力。理论证明COR随GSNR单调递增,表明SAM优化的几何不稳定性源于内在泛化能力下降。实验发现,层间GSNR衰减是导致非语义伪造检测崩溃的根本原因。单纯减小扰动半径虽能稳定收敛,但仅缓解症状而未解决泛化退化,需增强梯度保真度。据此,我们提出对比区域注入变换器(CoRIT),结合高效对比梯度代理(CGP)与三种无训练策略:区域精修掩码抑制CGP方差、区域信号注入保持CGP幅值、分层表示融合获得更泛化的表征。大量实验证明,CoRIT有效缓解优化崩溃,在跨域与通用伪造基准上达到当前最优泛化性能。

原文摘要 · Abstract (English)

While Vision-Language Models (VLMs) like CLIP have emerged as a dominant paradigm for generalizable deepfake detection, a representational disconnect remains: their semantic-centric pre-training is ill-suited for capturing non-semantic artifacts inherent to hyper-realistic synthesis. In this work, we identify a failure mode termed Optimization Collapse, where detectors trained with Sharpness-Aware Minimization (SAM) degenerate to random guessing on non-semantic forgeries once the perturbation radius exceeds a narrow threshold. To theoretically formalize this collapse, we propose the Critical Optimization Radius (COR) to quantify the geometric stability of the optimization landscape, and leverage the Gradient Signal-to-Noise Ratio (GSNR) to measure generalization potential. We establish a theorem proving that COR increases monotonically with GSNR, thereby revealing that the geometric instability of SAM optimization originates from degraded intrinsic generalization potential. This result identifies the layer-wise attenuation of GSNR as the root cause of Optimization Collapse in detecting non-semantic forgeries. Although naively reducing perturbation radius yields stable convergence under SAM, it merely treats the symptom without mitigating the intrinsic generalization degradation, necessitating enhanced gradient fidelity. Building on this insight, we propose the Contrastive Regional Injection Transformer (CoRIT), which integrates a computationally efficient Contrastive Gradient Proxy (CGP) with three training-free strategies: Region Refinement Mask to suppress CGP variance, Regional Signal Injection to preserve CGP magnitude, and Hierarchical Representation Integration to attain more generalizable representations. Extensive experiments demonstrate that CoRIT mitigates optimization collapse and achieves state-of-the-art generalization across cross-domain and universal forgery benchmarks.

伪造检测视觉语言模型优化稳定性泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。