arXiv:2604.07477cs.CVeess.IV2026-04

用人脸语义掩码驱动去模糊,无需参考图也能恢复清晰人脸。

SMFD-UNet: Semantic Face Mask Is The Only Thing You Need To Deblur Faces

  • 通过UNet生成模糊图中的人脸组件掩码,指导去模糊过程
  • 在CelebA上达到更高PSNR和SSIM,自然度指标也更优
  • 轻量设计适合实际应用,尤其适合无参考图的场景

在人脸识别、法医分析、摄影优化和医学影像诊断等应用中,人脸图像去模糊是计算机视觉的关键任务,旨在从模糊输入中恢复高质量图像。传统方法依赖通用图像先验,难以捕捉人脸特有的结构与身份特征。本文提出SMFD-UNet(语义掩码融合去模糊UNet),一种轻量级框架,仅使用语义人脸掩码驱动去模糊,无需高质量参考图。首先,基于UNet的掩码生成器直接从模糊图像中提取眼睛、鼻子、嘴巴等面部组件的精细掩码;随后,在计算高效的UNet框架内,通过多阶段特征融合将掩码与模糊输入结合,生成清晰高保真人脸图像。我们构建了一个随机模糊管道,模拟约1.74万亿种退化场景,确保模型鲁棒性。在CelebA数据集上,SMFD-UNet优于当前最优模型,获得更高的峰值信噪比(PSNR)和结构相似性指数(SSIM),同时保持良好的自然度(NIQE、LPIPS、FID)。该模型采用残差密集卷积块(RDC)、多阶段特征融合、高效上采样、注意力机制(如CBAM)、后处理技术及轻量设计,兼顾性能与效率,适用于人脸图像修复研究与实际部署。

原文摘要 · Abstract (English)

For applications including facial identification, forensic analysis, photographic improvement, and medical imaging diagnostics, facial image deblurring is an essential chore in computer vision allowing the restoration of high-quality images from blurry inputs. Often based on general picture priors, traditional deblurring techniques find it difficult to capture the particular structural and identity-specific features of human faces. We present SMFD-UNet (Semantic Mask Fusion Deblurring UNet), a new lightweight framework using semantic face masks to drive the deblurring process, therefore removing the need for high-quality reference photos in order to solve these difficulties. First, our dual-step method uses a UNet-based semantic mask generator to directly extract detailed facial component masks (e.g., eyes, nose, mouth) straight from blurry photos. Sharp, high-fidelity facial images are subsequently produced by integrating these masks with the blurry input using a multi-stage feature fusion technique within a computationally efficient UNet framework. We created a randomized blurring pipeline that roughly replicates real-world situations by simulating around 1.74 trillion deterioration scenarios, hence guaranteeing resilience. Examined on the CelebA dataset, SMFD-UNet shows better performance than state-of-the-art models, attaining higher Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) while preserving satisfactory naturalness measures, including NIQE, LPIPS, and FID. Powered by Residual Dense Convolution Blocks (RDC), a multi-stage feature fusion strategy, efficient and effective upsampling techniques, attention techniques like CBAM, post-processing techniques, and the lightweight design guarantees scalability and efficiency, enabling SMFD-UNet to be a flexible solution for developing facial image restoration research and useful applications.

人脸去模糊语义掩码轻量模型无参考

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。