用ChatGPT检测人脸攻击,少样本下表现优于专业模型
Exploring ChatGPT for Face Presentation Attack Detection in Zero and Few-Shot in-Context Learning
- 用上下文学习让GPT-4o识别伪造人脸,给更多样例性能更好
- 少样本时准确率超商用模型,能自发判断攻击类型
- 适合想快速验证的开发者,尤其关注可解释性
本研究探索GPT-4o在人脸活体攻击检测(PAD)中的潜力,发现其在特定场景下表现优于多个专用模型,包括商业方案。实验表明,在少样本上下文学习中,随着参考样本增加,GPT-4o性能持续提升,表现出高度一致性。详细提示词可使模型输出评分更可靠,而要求解释的提示词略有提升性能。令人惊讶的是,模型在未被明确指示分类攻击类型的情况下,仍能以高准确率正确预测攻击类型(打印或重放)。尽管如此,零样本任务中其表现仍不及专用系统。实验基于SOTERIA数据集子集进行,仅使用自愿者数据,符合数据隐私规范。这些结果凸显GPT-4o在PAD应用中的前景,为未来研究解决数据隐私与跨数据集泛化问题奠定基础。
原文摘要 · Abstract (English)
This study highlights the potential of ChatGPT (specifically GPT-4o) as a competitive alternative for Face Presentation Attack Detection (PAD), outperforming several PAD models, including commercial solutions, in specific scenarios. Our results show that GPT-4o demonstrates high consistency, particularly in few-shot in-context learning, where its performance improves as more examples are provided (reference data). We also observe that detailed prompts enable the model to provide scores reliably, a behavior not observed with concise prompts. Additionally, explanation-seeking prompts slightly enhance the model's performance by improving its interpretability. Remarkably, the model exhibits emergent reasoning capabilities, correctly predicting the attack type (print or replay) with high accuracy in few-shot scenarios, despite not being explicitly instructed to classify attack types. Despite these strengths, GPT-4o faces challenges in zero-shot tasks, where its performance is limited compared to specialized PAD systems. Experiments were conducted on a subset of the SOTERIA dataset, ensuring compliance with data privacy regulations by using only data from consenting individuals. These findings underscore GPT-4o's promise in PAD applications, laying the groundwork for future research to address broader data privacy concerns and improve cross-dataset generalization. Code available here: https://gitlab.idiap.ch/bob/bob.paper.wacv2025_chatgpt_face_pad
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。