用多图特征融合提升低质人脸超分辨率,不损身份信息。
Robust Face Super-Resolution and Recognition Through Multi-Feature Aggregation in Diffusion Models

- 通过扩散模型融合多张低质图像特征,生成高分辨率人脸。
- 在两个标准数据集上实现最优识别率与图像质量指标。
- 适合安防场景下低质量人脸重建与识别任务。
监控环境中获取的图像常因分辨率低、姿态变化、光照不均和遮挡等问题导致质量差,使人脸识别算法难以应对。为解决此问题,可采用超分辨率技术增强图像细节,但现有方法易引发图像失真或身份信息扭曲。本工作提出基于扩散模型的FASR++算法,利用参考低分辨率图像及多张辅助低质量图像提取的特征,生成高质量超分辨率结果,避免显式引入软属性或梯度引导。该方法有效恢复面部特征,在无需额外身份约束的情况下显著提升人脸识别性能。我们在两个标准人脸识别数据集上验证了该方法,其在验证、人脸识别以及PSNR、SSIM、LPIPS等图像质量指标上均达到当前最佳水平。
原文摘要 · Abstract (English)
Images acquired in surveillance environments often suffer from conditions such as low resolution, variations in pose, irregular illumination, and occlusions. Due to the low quality of these images, face recognition algorithms often struggle. This major limitation can be addressed by employing super-resolution techniques that enhance the details of the image. However, due to the high degree of difficulty of the problem, most super-resolution algorithms tend to cause distortions in the image and in the individual's identity. Thus, additional information must be incorporated into the processing to improve recognition robustness. In this regard, surveillance cameras can capture multiple images, even at low quality, and the data extracted from these images, such as consecutive video frames, can significantly enhance both super-resolution and facial recognition. In this work, we introduce FASR++, a diffusion-model-based super-resolution algorithm. It leverages a reference low-resolution image and features extracted from multiple auxiliary low-quality images to generate a super-resolved output, minimizing distortions in the individual's identity. Our approach recovers facial features without explicitly providing soft attributes or computing a function gradient to guide the reconstruction process. FASR++ generates high-quality images that can considerably improve performance in face recognition tasks when used as a pre-processing step. We validate our approach on two standard face recognition datasets and attain state-of-the-art results for verification, face recognition, and image quality metrics such as PSNR, SSIM, and LPIPS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。