arXiv:2412.02479cs.CVcs.AI2024-12被引 4

构建人脸识别在异常情况下的鲁棒性评测基准,发现现有模型易受干扰。

OODFace: Benchmarking Robustness of Face Recognition under Common Corruptions and Appearance Variations

  • 设计30种真实场景下的异常扰动,覆盖9类常见问题。
  • 19个模型+3个商用API测试,发现多数在模糊、遮挡下性能下降超40%。
  • 提供可复用工具包,适合研究鲁棒性和安全性的开发者使用。

随着深度学习的发展,人脸识别技术取得显著进展。然而我们发现,现有开源模型和商业算法在部分分布外(OOD)场景下缺乏鲁棒性,影响系统可靠性。本文提出OODFace,从常见图像退化和外观变化两个角度系统评估人脸识别模型的鲁棒性。设计30种针对人脸识别的分布外场景,涵盖9大类别,并在LFW、CFP-FP、YTF等公开数据集上构建三个鲁棒性基准:LFW-C/V、CFP-FP-C/V 和 YTF-C/V。对19个面部识别模型和3个商用API进行大规模实验,还开展物理层面的口罩遮挡测试。进一步从防御策略和视觉-语言模型(VLMs)角度探索解决方案。结果揭示了当前系统在分布外数据下的显著脆弱性,并提出若干改进方向。同时提供统一工具包,包含所有扰动类型,支持扩展至其他数据集。希望本工作能为未来提升人脸识别鲁棒性提供参考。

原文摘要 · Abstract (English)

With the rise of deep learning, facial recognition technology has seen extensive research and rapid development. Although facial recognition is considered a mature technology, we find that existing open-source models and commercial algorithms lack robustness in certain complex Out-of-Distribution (OOD) scenarios, raising concerns about the reliability of these systems. In this paper, we introduce OODFace, which explores the OOD challenges faced by facial recognition models from two perspectives: common corruptions and appearance variations. We systematically design 30 OOD scenarios across 9 major categories tailored for facial recognition. By simulating these challenges on public datasets, we establish three robustness benchmarks: LFW-C/V, CFP-FP-C/V, and YTF-C/V. We then conduct extensive experiments on 19 facial recognition models and 3 commercial APIs, along with extended physical experiments on face masks to assess their robustness. Next, we explore potential solutions from two perspectives: defense strategies and Vision-Language Models (VLMs). Based on the results, we draw several key insights, highlighting the vulnerability of facial recognition systems to OOD data and suggesting possible solutions. Additionally, we offer a unified toolkit that includes all corruption and variation types, easily extendable to other datasets. We hope that our benchmarks and findings can provide guidance for future improvements in facial recognition model robustness.

人脸识别鲁棒性数据集异常检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。