用基础模型检测人脸变形攻击,效果优于现有方法。
MADation: Face Morphing Attack Detection with Foundation Models
- 用CLIP模型结合LoRA微调,适配人脸变形攻击检测任务。
- 在多个数据集上表现优异,部分场景超越当前最佳方案。
- 首个将基础模型用于该任务的工作,代码已开源。
尽管近年来人脸识别算法性能显著提升,但这些技术进步也可能被用于制造高效攻击,威胁其安全部署。形态攻击检测(MAD)系统旨在早期识别特定类型的攻击——形态攻击,防止其在关键验证流程中被误认。基础模型(FM)从大量无标签数据中学习,具备出色的零样本泛化能力。虽然其在特定下游任务如MAD中的泛化能力可能较弱,但可通过微调保留预训练知识并快速适应。本文提出通过LoRA权重微调CLIP架构,并同时训练分类头,构建MADation框架。该方法在多个评估场景中表现优异,超越了其他基础模型与基于Transformer的基线模型,是首个将基础模型成功应用于MAD任务的工作。为促进可复现性与进一步研究,我们公开发布MADation实现代码。
原文摘要 · Abstract (English)
Despite the considerable performance improvements of face recognition algorithms in recent years, the same scientific advances responsible for this progress can also be used to create efficient ways to attack them, posing a threat to their secure deployment. Morphing attack detection (MAD) systems aim to detect a specific type of threat, morphing attacks, at an early stage, preventing them from being considered for verification in critical processes. Foundation models (FM) learn from extensive amounts of unlabelled data, achieving remarkable zero-shot generalization to unseen domains. Although this generalization capacity might be weak when dealing with domain-specific downstream tasks such as MAD, FMs can easily adapt to these settings while retaining the built-in knowledge acquired during pre-training. In this work, we recognize the potential of FMs to perform well in the MAD task when properly adapted to its specificities. To this end, we adapt FM CLIP architectures with LoRA weights while simultaneously training a classification header. The proposed framework, MADation surpasses our alternative FM and transformer-based frameworks and constitutes the first adaption of FMs to the MAD task. MADation presents competitive results with current MAD solutions in the literature and even surpasses them in several evaluation scenarios. To encourage reproducibility and facilitate further research in MAD, we publicly release the implementation of MADation at https://github.com/gurayozgur/MADation
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。