arXiv:2505.09073cs.CV2025-05被引 2

用2D图像学3D特征,让人脸识别更抗姿态变化。

2D-3D Attention and Entropy for Pose Robust 2D Facial Recognition

  • 用联合注意力机制对齐2D与3D人脸特征的共性
  • 在两个数据集上姿态差异下识别率提升超7%
  • 适合需要跨姿态识别的工业落地场景

尽管面部识别技术取得进展,但在注册图像与查询图像间存在显著视角(姿态)差异时,性能仍会下降。为此,我们提出一种新型域自适应框架,通过让基于图像的2D表示学习本质姿态不变的点云3D表示特性,从而提升大姿态差异下的表现。具体地,该框架利用(1)共享的联合注意力映射来强调2D人脸图像与3D数据间最相关的共同模式;(2)联合熵正则化损失,通过注意力图促进2D与3D表示交集部分的一致性,增强其相关性。在FaceScape和ARL-VTF数据集上的实验表明,该方法在90°偏侧姿态下,1%误报率时的真阳性率(TAR)分别提升至少7.1%和1.57%,优于现有方法。

原文摘要 · Abstract (English)

Despite recent advances in facial recognition, there remains a fundamental issue concerning degradations in performance due to substantial perspective (pose) differences between enrollment and query (probe) imagery. Therefore, we propose a novel domain adaptive framework to facilitate improved performances across large discrepancies in pose by enabling image-based (2D) representations to infer properties of inherently pose invariant point cloud (3D) representations. Specifically, our proposed framework achieves better pose invariance by using (1) a shared (joint) attention mapping to emphasize common patterns that are most correlated between 2D facial images and 3D facial data and (2) a joint entropy regularizing loss to promote better consistency$\unicode{x2014}$enhancing correlations among the intersecting 2D and 3D representations$\unicode{x2014}$by leveraging both attention maps. This framework is evaluated on FaceScape and ARL-VTF datasets, where it outperforms competitive methods by achieving profile (90$\unicode{x00b0}$$\unicode{x002b}$) TAR @ 1$\unicode{x0025}$ FAR improvements of at least 7.1$\unicode{x0025}$ and 1.57$\unicode{x0025}$, respectively.

人脸识别姿态鲁棒2D-3D对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。