arXiv:2411.13886cs.CV2024-11中稿 · publication in the…被引 5

CLFace让人脸识别模型持续学习新脸,不遗忘旧脸且无需存储原始数据。

CLFace: A Scalable and Resource-Efficient Continual Learning Framework for Lifelong Face Recognition

  • 移除分类层,用特征蒸馏和几何保持机制防止知识遗忘。
  • 在多个数据集上对未见人脸识别准确率提升12.3%以上。
  • 适合需要长期更新、注重隐私和资源效率的实时人脸识别场景。

将人脸识别算法部署于真实场景的关键挑战在于其持续学习新身份的能力。现有基于深度神经网络的离线预训练模型在在线学习时面临两大问题:(I)对已学身份产生灾难性遗忘;(II)需存储历史数据以完全重训,导致存储压力大且存在隐私风险。本文提出CLFace,一种可扩展且资源高效的持续学习框架,通过移除分类层构建固定不变的教师模型,为学生模型提供无标签监督,适用于开集人脸识别。设计特征级蒸馏目标,减少多阶段间特征图偏移;引入几何保持蒸馏,维持教师模型特征嵌入方向;并结合对比知识蒸馏,持续增强新身份间的判别能力。在多个基准数据集上的实验表明,CLFace在域内与域外数据上对未见身份的识别性能显著优于基线及当前最优方法。

原文摘要 · Abstract (English)

An important aspect of deploying face recognition (FR) algorithms in real-world applications is their ability to learn new face identities from a continuous data stream. However, the online training of existing deep neural network-based FR algorithms, which are pre-trained offline on large-scale stationary datasets, encounter two major challenges: (I) catastrophic forgetting of previously learned identities, and (II) the need to store past data for complete retraining from scratch, leading to significant storage constraints and privacy concerns. In this paper, we introduce CLFace, a continual learning framework designed to preserve and incrementally extend the learned knowledge. CLFace eliminates the classification layer, resulting in a resource-efficient FR model that remains fixed throughout lifelong learning and provides label-free supervision to a student model, making it suitable for open-set face recognition during incremental steps. We introduce an objective function that employs feature-level distillation to reduce drift between feature maps of the student and teacher models across multiple stages. Additionally, it incorporates a geometry-preserving distillation scheme to maintain the orientation of the teacher model's feature embedding. Furthermore, a contrastive knowledge distillation is incorporated to continually enhance the discriminative power of the feature representation by matching similarities between new identities. Experiments on several benchmark FR datasets demonstrate that CLFace outperforms baseline approaches and state-of-the-art methods on unseen identities using both in-domain and out-of-domain datasets.

人脸识别持续学习知识蒸馏隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。