不同人脸模型的嵌入空间可通过对齐实现高效互用。
Compatibility of Face Embeddings Across Deep Neural Networks
- 用仿射变换对齐不同模型的人脸嵌入表示
- 线性映射使跨模型识别准确率显著提升
- 适用于通用模型与专用模型间的互操作
过去十年,深度神经网络(DNN)在自动人脸识别领域取得飞速进展,尤其在特定任务上表现优异。与此同时,大规模预训练基础模型在视觉或图文任务上表现出色,且具备跨领域的强泛化能力,包括生物特征识别。这引发一个关键问题:不同DNN模型——无论是领域专用还是基础模型——是否以相似方式编码面部身份?尽管它们使用不同数据集、损失函数和架构进行训练。本文直接分析不同DNN模型生成的嵌入空间的几何结构。将人脸图像的嵌入视为点云,研究是否存在简单的仿射变换能对齐一个模型的表示与另一个模型。结果表明,跨模型兼容性显著:低容量线性映射可大幅提高未对齐基线在识别与验证任务中的性能,甚至在从未针对人脸识别训练的基础模型间也有效。对齐模式在不同数据集上具有普适性,且在不同模型族中呈现系统性差异,说明面部身份编码存在表征收敛现象。这一发现将独立训练的模板重新定义为可迁移而非不可撤销,对互操作性、集成设计及生物特征模板安全具有深远意义。
原文摘要 · Abstract (English)
Automated face recognition has made rapid strides over the past decade due to the unprecedented rise of deep neural network (DNN) models that can be trained for domain-specific tasks. At the same time, large foundation models that are pretrained on broad vision or vision-language tasks have shown impressive generalization across diverse domains, including biometrics. This raises an important question: Do different DNN models---both domain-specific and foundation models---encode facial identity in similar ways, despite being trained on different datasets, loss functions, and architectures? In this regard, we directly analyze the geometric structure of embedding spaces imputed by different DNN models. Treating embeddings of face images as point clouds, we study whether simple affine transformations can align face representations of one model with another. Our findings reveal substantial cross-model compatibility: low-capacity linear mappings substantially improve cross-model face recognition over unaligned baselines for both identification and verification, including across foundation models never trained for face recognition. Alignment patterns generalize across datasets and vary systematically across model families, indicating representational convergence in facial identity encoding. These findings reframe independently trained templates as transferable rather than revocable, with implications for interoperability, ensemble design, and biometric template security.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。