arXiv:2510.15520cs.CVcs.LG2025-10被引 2

通过方向对齐发现人脸识别中的交叉偏见,揭示传统方法忽略的隐藏风险。

Discovering Intersectional Bias via Directional Alignment in Face Recognition Embeddings

  • 基于嵌入空间的方向对齐,无须预设属性标签发现子群体。
  • 在4个模型、2个数据集上表现优于传统聚类方法,最高误匹配率高出4倍。
  • 适合关注模型公平性与隐性偏见检测的研究者和工程师。

现代人脸识别模型将身份嵌入单位超球面,身份差异形成紧密簇。相反,共享语义属性常可近似为潜在空间中的线性方向。现有偏见评估方法依赖预定义属性标签、合成反事实或基于距离的聚类,均无法捕捉沿潜在方向出现的交叉子群体。我们提出无属性算法LatentAlign,通过迭代对齐主导潜在方向,发现语义连贯且可解释的子群体。不同于基于距离的聚类,LatentAlign利用超球面嵌入的几何结构,分离跨身份共享的方向结构,实现属性的可解释发现。在四个主流识别主干网络(ArcFace、CosFace、ElasticFace、PartialFC)和两个基准数据集(RFW、CelebA)上,LatentAlign始终优于k-means、球面k-means、最近邻搜索和DBSCAN。关键发现是,所揭示的子群体暴露严重交叉偏见,误匹配率最高达标注组的4倍。结果表明,将语义属性视为方向特征而非空间簇,可有效隔离交叉子群体,揭露标准审计遗漏的隐蔽偏见。

原文摘要 · Abstract (English)

Modern face recognition models embed identities on a unit hypersphere, where identity variation forms tight clusters. Conversely, shared semantic attributes can often be effectively approximated as linear directions in the latent space. Existing bias evaluation methods rely on predefined attribute labels, synthetic counterfactuals, or proximity-based clustering, all of which fail to capture intersectional subpopulations that emerge along latent directions. We introduce LatentAlign, an attribute-free algorithm that discovers semantically coherent and interpretable subpopulations by iteratively aligning embeddings along dominant latent directions. Unlike distance-based clustering, LatentAlign exploits the geometry of hyperspherical embeddings to isolate directional structures shared across identities, allowing for the interpretable discovery of attributes. Across four state-of-the-art recognition backbones (ArcFace, CosFace, ElasticFace, PartialFC) and two benchmarks (RFW, CelebA), LatentAlign consistently yields more semantically coherent groups than $k$-means, spherical $k$-means, nearest-neighbor search, and DBSCAN. Crucially, the discovered subpopulations expose severe intersectional vulnerabilities, with False Match Rates up to 4x higher than groups defined by explicit annotations. Our results show that by treating semantic attributes as directional features rather than spatial clusters, we can effectively isolate intersectional subpopulations and expose hidden biases that standard audits miss.

人脸识别交叉偏见嵌入分析公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。