arXiv:2410.17622cs.CV2024-10被引 4

用无标签人脸数据提升小样本表情识别,效果接近全监督方法。

Bridging the Gaps: Utilizing Unlabeled Face Recognition Datasets to Boost Semi-Supervised Facial Expression Recognition

  • 先无监督预训练再两阶段微调,利用大规模无标注人脸数据学习特征。
  • 仅用5%或25%标注数据,在AffectNet上达64.02%,RAF-DB上达88.23%。
  • 设计基于IoU的Mixup增强策略,适合人脸图像,缓解标注稀缺问题。

近年来,面部表情识别(FER)受到广泛关注。现有工作多依赖有监督学习,需大量标注且多样化的图像,但FER面临大规模、多样化数据集稀缺与标注困难的问题。为此,本文提出利用大规模无标注人脸识别(FR)数据集来提升半监督FER性能。具体而言,先在无标注大规模人脸图像上进行面部重建预训练,学习面部几何与表情区域特征,随后在标注有限的FER数据集上进行两阶段微调。为进一步缓解标注数据不足,提出一种针对人脸图像的Mixup数据增强策略,真实与虚拟图像的损失权重由两图中人脸的交并比(IoU)决定。在RAF-DB、AffectNet和FERPlus上的实验表明,该方法优于现有半监督FER方法,并达到新最优性能。值得注意的是,仅使用5%或25%的训练集,便在AffectNet上取得64.02%准确率,在RAF-DB上达88.23%,接近全监督最先进水平。代码将公开于https://github.com/zhelishisongjie/SSFER。

原文摘要 · Abstract (English)

In recent years, Facial Expression Recognition (FER) has gained increasing attention. Most current work focuses on supervised learning, which requires a large amount of labeled and diverse images, while FER suffers from the scarcity of large, diverse datasets and annotation difficulty. To address these problems, we focus on utilizing large unlabeled Face Recognition (FR) datasets to boost semi-supervised FER. Specifically, we first perform face reconstruction pre-training on large-scale facial images without annotations to learn features of facial geometry and expression regions, followed by two-stage fine-tuning on FER datasets with limited labels. In addition, to further alleviate the scarcity of labeled and diverse images, we propose a Mixup-based data augmentation strategy tailored for facial images, and the loss weights of real and virtual images are determined according to the intersection-over-union (IoU) of the faces in the two images. Experiments on RAF-DB, AffectNet, and FERPlus show that our method outperforms existing semi-supervised FER methods and achieves new state-of-the-art performance. Remarkably, with only 5%, 25% training sets,our method achieves 64.02% on AffectNet,and 88.23% on RAF-DB, which is comparable to fully supervised state-of-the-art methods. Codes will be made publicly available at https://github.com/zhelishisongjie/SSFER.

表情识别半监督数据增强人脸识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。