arXiv:2505.07734cs.CV2025-05中稿 · ECAI 2025被引 1

通过分层注意力调制,精准识别各类AI生成人脸的结构异常。

LAMM-ViT: AI Face Detection via Layer-Aware Modulation of Region-Guided Attention

  • 用面部关键点引导区域注意力,捕捉不同区域间的结构不一致。
  • 跨模型测试中准确率94.09%,比当前最佳方法高5.45%。
  • 适合对抗新型生成模型,部署于真实场景的伪造检测系统。

检测AI合成人脸是一项严峻挑战:不同生成技术间面部区域的结构关系难以保持一致。现有方法聚焦特定伪影,而非根本性不一致性,面对新生成模型时常失效。为此,我们提出分层掩码调制视觉变换器(LAMM-ViT),一种用于鲁棒人脸伪造检测的视觉变换器。该模型在每一层集成区域引导多头注意力(RG-MHA)与分层掩码调制(LAMM)模块。RG-MHA利用面部关键点生成区域注意力掩码,引导模型关注不同面部区域的架构不一致。关键的是,独立的LAMM模块基于网络上下文动态生成层特定参数,包括掩码权重和门控值,并调制RG-MHA行为,实现区域关注随网络深度自适应调整。该架构能捕获多种生成技术(如GANs和Diffusion Models)普遍存在的细微、层级化伪造线索。在跨模型泛化测试中,LAMM-ViT表现优异,平均准确率94.09%(较SOTA提升5.45%),平均精度98.62%(提升3.09%)。结果表明其具备卓越泛化能力,适用于应对不断演进的合成媒体威胁。

原文摘要 · Abstract (English)

Detecting AI-synthetic faces presents a critical challenge: it is hard to capture consistent structural relationships between facial regions across diverse generation techniques. Current methods, which focus on specific artifacts rather than fundamental inconsistencies, often fail when confronted with novel generative models. To address this limitation, we introduce Layer-aware Mask Modulation Vision Transformer (LAMM-ViT), a Vision Transformer designed for robust facial forgery detection. This model integrates distinct Region-Guided Multi-Head Attention (RG-MHA) and Layer-aware Mask Modulation (LAMM) components within each layer. RG-MHA utilizes facial landmarks to create regional attention masks, guiding the model to scrutinize architectural inconsistencies across different facial areas. Crucially, the separate LAMM module dynamically generates layer-specific parameters, including mask weights and gating values, based on network context. These parameters then modulate the behavior of RG-MHA, enabling adaptive adjustment of regional focus across network depths. This architecture facilitates the capture of subtle, hierarchical forgery cues ubiquitous among diverse generation techniques, such as GANs and Diffusion Models. In cross-model generalization tests, LAMM-ViT demonstrates superior performance, achieving 94.09% mean ACC (a +5.45% improvement over SoTA) and 98.62% mean AP (a +3.09% improvement). These results demonstrate LAMM-ViT's exceptional ability to generalize and its potential for reliable deployment against evolving synthetic media threats.

人脸伪造视觉变换器生成对抗安全检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。