arXiv:2412.07771cs.CV2024-12中稿 · WACV 2025被引 10

用极少量参数实现低分辨率人脸识别,解决模型遗忘与画质差异问题。

PETALface: Parameter Efficient Transfer Learning for Low-resolution Face Recognition

  • 采用参数高效微调技术,避免模型遗忘预训练知识。
  • 引入双低秩模块,根据图像质量动态调整特征提取。
  • 仅用0.48%参数量,显著优于全量微调,适合资源受限场景。

在大规模数据集上预训练并使用基于边距的损失函数,在高分辨率人脸识别中表现优异。然而,这些模型在低分辨率人脸数据集上表现不佳,因面部细节不足难以区分个体。对低分辨率数据集进行全量微调会引发灾难性遗忘,且高分辨率图库与低分辨率查询图像间的域差异导致模型难以同时适应两者。为此,我们提出PETALface,一种面向低分辨率人脸识别的参数高效迁移学习方法。通过PETALface,我们同时解决上述问题:(1)利用参数高效微调(PEFT)缓解灾难性遗忘;(2)在主干网络中引入两个低秩适配模块,其权重依据输入图像质量动态调整,以应对图库与查询图像的质量差异。据我们所知,PETALface是首个将PEFT应用于低分辨率人脸识别的工作。大量实验表明,该方法在低分辨率数据集上优于全量微调,同时保持在高分辨率和混合质量数据集上的性能,且仅使用0.48%的参数量。

原文摘要 · Abstract (English)

Pre-training on large-scale datasets and utilizing margin-based loss functions have been highly successful in training models for high-resolution face recognition. However, these models struggle with low-resolution face datasets, in which the faces lack the facial attributes necessary for distinguishing different faces. Full fine-tuning on low-resolution datasets, a naive method for adapting the model, yields inferior performance due to catastrophic forgetting of pre-trained knowledge. Additionally the domain difference between high-resolution (HR) gallery images and low-resolution (LR) probe images in low resolution datasets leads to poor convergence for a single model to adapt to both gallery and probe after fine-tuning. To this end, we propose PETALface, a Parameter-Efficient Transfer Learning approach for low-resolution face recognition. Through PETALface, we attempt to solve both the aforementioned problems. (1) We solve catastrophic forgetting by leveraging the power of parameter efficient fine-tuning(PEFT). (2) We introduce two low-rank adaptation modules to the backbone, with weights adjusted based on the input image quality to account for the difference in quality for the gallery and probe images. To the best of our knowledge, PETALface is the first work leveraging the powers of PEFT for low resolution face recognition. Extensive experiments demonstrate that the proposed method outperforms full fine-tuning on low-resolution datasets while preserving performance on high-resolution and mixed-quality datasets, all while using only 0.48% of the parameters. Code: https://kartik-3004.github.io/PETALface/

人脸识别参数高效低分辨率迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。