arXiv:2607.18770cs.CRcs.CV2026-07

用几何特征修复人脸伪造检测器对新生成模型的盲区

GLID: Gated Local Intrinsic Dimension Repairs the Blind Spots of Face-Forgery Detectors

论文配图:GLID: Gated Local Intrinsic Dimension Repairs the Blind Spots of Face-Forgery Detectors
图 1 · 摘自论文原文
  • 通过分析图像块在视觉变换器中的局部内在维数,构建无需训练的几何信号
  • 在16类跨生成模型测试中平均AUC达0.805,提升伪造检测能力0.084
  • 特别适合应对无训练数据的新生成模型,且结果更稳定

微调的基础模型检测器虽在主流人脸伪造基准上表现优异,但对训练中未出现的生成模型家族仍无法识别。本文提出GLID,一种基于几何而非数据的检测方法:将单张图像的块令牌视为流形样本,估计其在冻结视觉变换器多层中的局部内在维数(LID)。该12维、无需训练的信号通过信心门进入微调检测器,门控强度仅在分布内校准。在16轴跨生成模型基准上,GLID达到0.805平均AUC,优于所有重训练的最先进基线,且在任一轴上均不显著落后于最强模型。它使伪造检测性能提升+0.084 AUC,而对重演类影响仅-0.005。两个经验规律解释设计:首先,伪造人脸在特定深度扭曲令牌流形——GAN伪影在最后一层峰值,扩散伪影在中间层峰值,此模式在四种骨干网络、三种维数估计器及非人脸图像中均成立;其次,微调仅吸收训练数据覆盖范围内的增益:注入1%目标家族图像即消除+0.100的增益,表明几何信号在数据缺失时尤为关键。该确定性信号还将跨种子精度波动降低5.5倍。代码、预注册分析门及每图得分随论文发布。

原文摘要 · Abstract (English)

Fine-tuned foundation-model detectors dominate face-forgery benchmarks, yet they stay blind to generator families absent from training. We present GLID, a detector that repairs this blind spot with geometry instead of data. GLID treats the patch tokens of a single image as a sample from a manifold and estimates their local intrinsic dimension (LID) at several depths of a frozen vision transformer. This 12-dimensional, training-free signal enters a fine-tuned detector through a confidence gate whose strength is calibrated purely in-distribution. On a 16-axis cross-generator benchmark, GLID reaches 0.805 mean AUC, first among retrained state-of-the-art baselines and never significantly behind the strongest of them on any axis. It lifts the generation axes by +0.084 AUC while moving reenactment by only -0.005. Two empirical laws explain the design. First, forged faces bend the token manifold at family-specific depths: GAN artifacts peak at the last layer, diffusion artifacts peak mid-network, and the pattern survives four backbones, three dimension estimators, and non-face imagery. Second, fine-tuning absorbs auxiliary gains exactly where training data covers: injecting 1% target-family images erases a +0.100 gain, so geometric signals matter precisely where data is unavailable. The deterministic signal also cuts the cross-seed spread of accuracy 5.5x. Code, preregistered analysis gates, and per-image scores accompany the paper.

伪造检测几何特征无监督稳定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。