通过知识蒸馏让模型学先验,提升人脸超分辨率质量
Prior Knowledge Distillation Network for Face Super-Resolution
- 用教师-学生架构蒸馏先验信息,训练时学,测试时只用低分辨率图
- 设计注意力融合模块,更有效利用先验特征,减少信息损失
- 适合需要高精度人脸重建的应用,如刑侦、视频增强
人脸超分辨率(FSR)旨在从低分辨率(LR)输入重建高分辨率(HR)人脸图像。随着深度学习发展,现有基于先验的方法先估计面部先验,再用于辅助重建。然而,先验估计的准确性难以保证,简单的级联与卷积操作也未能充分挖掘先验信息,导致性能下降。为此,本文提出先验知识蒸馏网络(PKDN),将教师网络中的先验信息传递至学生网络,在训练阶段学习先验,测试阶段仅依赖低分辨率人脸图像,从而缓解先验估计误差的影响。此外,引入鲁棒注意力机制设计解析图融合模块,有效利用先验信息。为防止特征丢失,保留多尺度特征并用于后续重建。在基准数据集上的实验表明,所提方法在生成高质量人脸图像方面优于现有方法。
原文摘要 · Abstract (English)
The purpose of face super-resolution (FSR) is to reconstruct high-resolution (HR) face images from low-resolution (LR) inputs. With the continuous advancement of deep learning technologies, contemporary prior-guided FSR methods initially estimate facial priors and then use this information to assist in the super-resolution reconstruction process. However, ensuring the accuracy of prior estimation remains challenging, and straightforward cascading and convolutional operations often fail to fully leverage prior knowledge. Inaccurate or insufficiently utilized prior information inevitably degrades FSR performance. To address this issue, we propose a prior knowledge distillation network (PKDN) for FSR, which involves transferring prior information from the teacher network to the student network. This approach enables the network to learn priors during the training stage while relying solely on low-resolution facial images during the testing stage, thus mitigating the adverse effects of prior estimation inaccuracies. Additionally, we incorporate robust attention mechanisms to design a parsing map fusion block that effectively utilizes prior information. To prevent feature loss, we retain multi-scale features during the feature extraction stage and employ them in the subsequent super-resolution reconstruction process. Experimental results on benchmark datasets demonstrate that our PKDN approach surpasses existing FSR methods in generating high-quality face images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。