用嵌入空间定义人脸可识别性,无需标注也能精准评估。
TransFIRA: Transfer Learning for Face Image Recognizability Assessment
- 基于类中心相似度和角度分离定义可识别性,贴合模型决策边界。
- 在BRIAR和IJB-C上达顶尖验证准确率,与真实可识别性相关性翻倍。
- 适用于人脸和人体识别,可解释退化因素影响,适合安全场景使用。
在监控、视频和网络图像等非受限环境下,人脸识别面临姿态、模糊、光照和遮挡等极端变化,传统视觉质量指标无法预测输入是否真正可被部署的编码器识别。现有面部图像可识别性评估(FIQA)方法通常依赖视觉启发式、人工标注或计算量大的生成流程,其预测与编码器决策几何脱节。本文提出TransFIRA(面向可识别性评估的迁移学习框架),一个轻量级且无需标注的框架,将可识别性直接锚定在嵌入空间。TransFIRA实现三大突破:(i) 通过类中心相似度(CCS)和类中心角分离(CCAS)定义可识别性,首次提供与决策边界对齐的自然判据,用于过滤与加权;(ii) 提出基于可识别性的聚合策略,在BRIAR和IJB-C数据集上实现顶尖验证准确率,同时使相关性接近翻倍,全程无需外部标签、启发式规则或主干网络特定训练;(iii) 拓展至非人脸场景,包括编码器驱动的可解释性分析,揭示退化与个体特征对可识别性的影响,并首次提出身体可识别性评估方法。实验表明,TransFIRA在人脸任务上达到顶尖性能,对身体识别也表现强劲,且在跨数据集迁移和分布外评估中保持鲁棒。这些贡献共同建立了一个统一、几何驱动的可识别性评估框架,具备编码器特异性、高精度、可解释性和跨模态扩展性,显著提升FIQA在准确性、可解释性与应用范围上的水平。
原文摘要 · Abstract (English)
Face recognition in unconstrained environments such as surveillance, video, and web imagery must contend with extreme variation in pose, blur, illumination, and occlusion, where conventional visual quality metrics fail to predict whether inputs are truly recognizable to the deployed encoder. Existing FIQA methods typically rely on visual heuristics, curated annotations, or computationally intensive generative pipelines, leaving their predictions detached from the encoder's decision geometry. We introduce TransFIRA (Transfer Learning for Face Image Recognizability Assessment), a lightweight and annotation-free framework that grounds recognizability directly in embedding space. TransFIRA delivers three advances: (i) a definition of recognizability via class-center similarity (CCS) and class-center angular separation (CCAS), yielding the first natural, decision-boundary-aligned criterion for filtering and weighting; (ii) a recognizability-informed aggregation strategy that achieves state-of-the-art verification accuracy on BRIAR and IJB-C while nearly doubling correlation with true recognizability, all without external labels, heuristics, or backbone-specific training; and (iii) new extensions beyond faces, including encoder-grounded explainability that reveals how degradations and subject-specific factors affect recognizability, and the first method for body recognizability assessment. Experiments confirm state-of-the-art results on faces, strong performance on body recognition, and robustness under cross-dataset shifts and out-of-distribution evaluation. Together, these contributions establish TransFIRA as a unified, geometry-driven framework for recognizability assessment that is encoder-specific, accurate, interpretable, and extensible across modalities, significantly advancing FIQA in accuracy, explainability, and scope.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。