无需微调,从预训练模型中挖掘出通用伪造检测能力
DNA: Uncovering Universal Latent Forgery Knowledge
- 通过粗到细机制定位模型中敏感伪造特征的中间层
- 提取出对伪造痕迹高度敏感的判别单元(FDUs)
- 在少样本和跨模型场景下表现优异,适合快速部署
随着生成式AI逼近超真实水平,传统表面伪影检测已失效。现有方法依赖资源密集型黑箱模型微调,我们提出伪造检测能力实际上已编码于预训练模型中,无需端到端重训练。为此,我们提出判别神经锚点(DNA)框架,采用粗到细挖掘机制:首先通过分析特征解耦与注意力分布变化,定位模型从全局语义转向局部异常的关键中间层;随后引入三元融合评分与曲率截断策略,剔除语义冗余,精准分离出内在敏感伪造痕迹的判别单元(FDUs)。此外,我们构建了基于最新模型的高保真合成基准数据集HIFI-Gen,以弥补现有数据集滞后问题。实验表明,仅依赖这些锚点,DNA在少样本条件下仍取得更优检测性能,并在多种架构及未见生成模型上展现卓越鲁棒性,验证唤醒潜在神经元比大规模微调更有效。
原文摘要 · Abstract (English)
As generative AI achieves hyper-realism, superficial artifact detection has become obsolete. While prevailing methods rely on resource-intensive fine-tuning of black-box backbones, we propose that forgery detection capability is already encoded within pre-trained models rather than requiring end-to-end retraining. To elicit this intrinsic capability, we propose the discriminative neural anchors (DNA) framework, which employs a coarse-to-fine excavation mechanism. First, by analyzing feature decoupling and attention distribution shifts, we pinpoint critical intermediate layers where the focus of the model logically transitions from global semantics to local anomalies. Subsequently, we introduce a triadic fusion scoring metric paired with a curvature-truncation strategy to strip away semantic redundancy, precisely isolating the forgery-discriminative units (FDUs) inherently imprinted with sensitivity to forgery traces. Moreover, we introduce HIFI-Gen, a high-fidelity synthetic benchmark built upon the very latest models, to address the lag in existing datasets. Experiments demonstrate that by solely relying on these anchors, DNA achieves superior detection performance even under few-shot conditions. Furthermore, it exhibits remarkable robustness across diverse architectures and against unseen generative models, validating that waking up latent neurons is more effective than extensive fine-tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。