用结构化代码替代标签,让大规模人脸识别计算成本从线性变对数。
GIF: Generative Inspiration for Face Recognition at Scale
- 将原子标签转为整数序列,用生成式思路重构身份表示。
- 在IJB-B/C上分别提升1.52%和0.6%准确率,计算成本降为对数增长。
- 适合追求高效率大规模人脸识别的工程与研究者使用。
为降低大规模人脸识别数据集下Softmax的计算开销,现有方法通过子集估计输出。然而,计算成本与身份数量的关系仅在比例下降时保持线性。当前人脸识别方法普遍采用训练阶段的标量标签,输入通过特征向量与Softmax中心点的点积匹配身份。受生成建模启发,本文提出一种简单有效的方法:将标量标签替换为结构化身份码(一串整数)。具体地,设计标签分词方案将原始标签转换为结构化编码,并训练主干网络预测输入对应的身份码而非标量标签。结果使计算成本随身份数增长变为对数级。实验表明,该方法在IJB-B和IJB-C上分别取得TAR@FAR=1e-4下1.52%和0.6%的性能提升,同时将计算成本与身份数的关系从线性转变为对数。代码见https://github.com/msed-Ebrahimi/GIF。
原文摘要 · Abstract (English)
Aiming to reduce the computational cost of Softmax in massive label space of Face Recognition (FR) benchmarks, recent studies estimate the output using a subset of identities. Although promising, the association between the computation cost and the number of identities in the dataset remains linear only with a reduced ratio. A shared characteristic among available FR methods is the employment of atomic scalar labels during training. Consequently, the input to label matching is through a dot product between the feature vector of the input and the Softmax centroids. Inspired by generative modeling, we present a simple yet effective method that substitutes scalar labels with structured identity code, i.e., a sequence of integers. Specifically, we propose a tokenization scheme that transforms atomic scalar labels into structured identity codes. Then, we train an FR backbone to predict the code for each input instead of its scalar label. As a result, the associated computational cost becomes logarithmic w.r.t. number of identities. We demonstrate the benefits of the proposed method by conducting experiments. In particular, our method outperforms its competitors by 1.52%, and 0.6% at TAR@FAR$=1e-4$ on IJB-B and IJB-C, respectively, while transforming the association between computational cost and the number of identities from linear to logarithmic. See code at https://github.com/msed-Ebrahimi/GIF
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。