提出新方法提升恶劣天气下人脸修复质量,减少纹理失真。
Degradation-Agnostic Statistical Facial Feature Transformation for Blind Face Restoration in Adverse Weather Conditions
- 用统计特征变换增强局部面部结构与颜色保真度
- 在恶劣天气下显著降低纹理畸变,提升结构重建精度
- 适合智能监控等户外场景中的人脸识别应用
随着智能CCTV系统在户外环境中的广泛应用,对恶劣天气下优化的人脸识别系统需求日益增长。恶劣天气严重降低图像质量,进而影响识别准确率。尽管基于生成对抗网络(GAN)和扩散模型的最新人脸图像恢复(FIR)方法已取得进展,但其性能仍受限于缺乏专门处理气象退化的模块,导致面部纹理和结构失真。为此,我们提出一种新型基于GAN的盲态人脸识别恢复框架,集成两个关键组件:局部统计面部特征变换(SFFT)和退化无关特征嵌入(DAFE)。SFFT模块通过将低质量(LQ)面部区域的局部统计分布与高质量(HQ)对应区域对齐,提升面部结构与颜色保真度;DAFE模块则通过对齐LQ与HQ编码器表示,实现恶劣天气下的鲁棒统计特征提取,使恢复过程适应严重气象退化。实验结果表明,所提出的退化无关SFFT模型优于现有基于GAN和扩散模型的先进FIR方法,尤其在抑制纹理畸变和准确重建面部结构方面表现突出。此外,SFFT与DAFE模块在挑战性天气场景中均被实证验证,有效提升了结构保真度与感知质量。
原文摘要 · Abstract (English)
With the increasing deployment of intelligent CCTV systems in outdoor environments, there is a growing demand for face recognition systems optimized for challenging weather conditions. Adverse weather significantly degrades image quality, which in turn reduces recognition accuracy. Although recent face image restoration (FIR) models based on generative adversarial networks (GANs) and diffusion models have shown progress, their performance remains limited due to the lack of dedicated modules that explicitly address weather-induced degradations. This leads to distorted facial textures and structures. To address these limitations, we propose a novel GAN-based blind FIR framework that integrates two key components: local Statistical Facial Feature Transformation (SFFT) and Degradation-Agnostic Feature Embedding (DAFE). The local SFFT module enhances facial structure and color fidelity by aligning the local statistical distributions of low-quality (LQ) facial regions with those of high-quality (HQ) counterparts. Complementarily, the DAFE module enables robust statistical facial feature extraction under adverse weather conditions by aligning LQ and HQ encoder representations, thereby making the restoration process adaptive to severe weather-induced degradations. Experimental results demonstrate that the proposed degradation-agnostic SFFT model outperforms existing state-of-the-art FIR methods based on GAN and diffusion models, particularly in suppressing texture distortions and accurately reconstructing facial structures. Furthermore, both the SFFT and DAFE modules are empirically validated in enhancing structural fidelity and perceptual quality in face restoration under challenging weather scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。