arXiv:2412.05721cs.CV2024-12被引 6

戴墨镜会显著降低人脸识别准确率,且与模糊或低分辨率影响相当。

Impact of Sunglasses on One-to-Many Facial Identification Accuracy

  • 系统研究墨镜对监控画面中人脸比对的影响机制。
  • 墨镜使识别准确率下降幅度相当于强模糊或低分辨率,叠加效应更严重。
  • 通过合成数据增强可恢复约38%的损失准确率,适合司法与安防领域参考。

一比多人脸识别在双方均为高质量证件照时表现优异,但近年多起误判案件引发对其准确性的质疑。实际应用中,探测图像常来自监控视频,质量远低于证件照。本文系统研究了佩戴深色墨镜对一比多人脸识别准确率的影响。结果表明,墨镜导致的准确率下降程度与强模糊或明显低分辨率相当;若同时存在墨镜与模糊/低分辨率,则准确率损失更为显著。该结果对制定探测图像质量评估标准具有重要意义。为缓解墨镜带来的准确率下降,我们发现仅通过合成方式在所有样本中添加墨镜图像(无需模型重训练),即可恢复约38%的准确率损失。此外,现有训练集中戴墨镜图像极为稀少,增加此类样本能大幅降低错误率。本研究构建的图像数据集已公开,网址:https://cvrl.nd.edu/projects/data/,以支持复现与进一步研究。

原文摘要 · Abstract (English)

One-to-many facial identification is documented to achieve high accuracy in the case where both the probe and the gallery are "mugshot quality" images. However, an increasing number of documented instances of wrongful arrest following one-to-many facial identification have raised questions about its accuracy. Probe images used in one-to-many facial identification are often cropped from frames of surveillance video and deviate from "mugshot quality" in various ways. This paper systematically explores how the accuracy of one-to-many facial identification is degraded by the person in the probe image choosing to wear dark sunglasses. We show that sunglasses degrade accuracy for mugshot-quality images by an amount similar to strong blur or noticeably lower resolution. Further, we demonstrate that the combination of sunglasses with blur or lower resolution results in even more pronounced loss in accuracy. These results have important implications for developing objective criteria to qualify a probe image for the level of accuracy to be expected if it used for one-to-many identification. To ameliorate the accuracy degradation caused by dark sunglasses, we show that it is possible to recover about 38% of the lost accuracy by synthetically adding sunglasses to all the gallery images, without model re-training. We also show that the frequency of wearing-sunglasses images is very low in existing training sets, and that increasing the representation of wearing-sunglasses images can greatly reduce the error rate. The image set assembled for this research is available at https://cvrl.nd.edu/projects/data/ to support replication and further research.

人脸识别墨镜影响数据增强监控安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。