用深度学习检测人脸图像压缩伪影,提升识别可靠性。
Deep Learning-based Compression Detection for explainable Face Image Quality Assessment
- 训练神经网络识别JPEG和JPEG 2000压缩伪影
- 使用PSNR标签训练,检测误差仅2-3%
- 可帮助淘汰劣质图像,适合图像质量评估场景
人脸图像质量评估对保障人脸识别可靠性至关重要。为向数据主体和操作者提供可解释、可操作的反馈,需量化影响图像实用性的质量因素。已知会降低图像效用的成分包括JPEG和JPEG 2000压缩伪影。压缩会导致重要细节丢失,进而影响识别性能。本文训练深度神经网络以检测人脸图像中的压缩伪影:将无伪影人脸图像分别用JPEG和JPEG 2000算法压缩,并基于PSNR与SSIM指标生成训练标签。采用单一网络分别检测两类压缩伪影。实验表明,使用PSNR标签训练时,检测误差率为2-3%。此外,剔除严重压缩伪影的图像后,多种开源及商用人脸识别系统的错误率显著降低。为减少资源消耗,算法基于EfficientNetV2构建,已集成至OFIQ软件中。
原文摘要 · Abstract (English)
The assessment of face image quality is crucial to ensure reliable face recognition. In order to provide data subjects and operators with explainable and actionable feedback regarding captured face images, relevant quality components have to be measured. Quality components that are known to negatively impact the utility of face images include JPEG and JPEG 2000 compression artefacts, among others. Compression can result in a loss of important image details which may impair the recognition performance. In this work, deep neural networks are trained to detect the compression artefacts in a face images. For this purpose, artefact-free facial images are compressed with the JPEG and JPEG 2000 compression algorithms. Subsequently, the PSNR and SSIM metrics are employed to obtain training labels based on which neural networks are trained using a single network to detect JPEG and JPEG 2000 artefacts, respectively. The evaluation of the proposed method shows promising results: in terms of detection accuracy, error rates of 2-3% are obtained for utilizing PSNR labels during training. In addition, we show that error rates of different open-source and commercial face recognition systems can be significantly reduced by discarding face images exhibiting severe compression artefacts. To minimize resource consumption, EfficientNetV2 serves as basis for the presented algorithm, which is available as part of the OFIQ software.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。