首次从生物面部特征层面提升人脸识别公平性,解决标签少与属性依赖难题。
Component-Based Fairness in Face Attribute Classification with Bayesian Network-informed Meta Learning
- 用贝叶斯网络指导元学习重加权,动态追踪模型偏差
- 在真实数据集上显著优于现有公平性方法,提升性别等维度公平性
- 为面部组件公平性作为人口统计公平性代理目标提供新思路
人脸识别技术广泛应用在门禁控制、个性化广告等领域,公平性至关重要。以往研究聚焦于人口统计公平性,而个体生物面部特征的公平性尚未被探索。本文首次关注面部组件公平性,即基于生物面部特征定义的公平性。我们识别出两大挑战:属性标签稀缺和属性间依赖关系,二者限制了已有方法的偏见缓解效果。为此,提出贝叶斯网络引导的元重加权(BNMR)方法,通过贝叶斯网络校准器动态追踪模型偏差,并编码面部组件属性的先验概率,以指导自适应元学习重加权。在大规模真实人脸数据集上的实验表明,BNMR持续优于近期基准方法。结果还显示,面部组件公平性对传统人口统计公平性(如性别)有正向影响。研究为面部组件公平性提供了新方向,提示其可作为人口统计公平性的潜在替代目标。代码已开源。
原文摘要 · Abstract (English)
The widespread integration of face recognition technologies into various applications (e.g., access control and personalized advertising) necessitates a critical emphasis on fairness. While previous efforts have focused on demographic fairness, the fairness of individual biological face components remains unexplored. In this paper, we focus on face component fairness, a fairness notion defined by biological face features. To our best knowledge, our work is the first work to mitigate bias of face attribute prediction at the biological feature level. In this work, we identify two key challenges in optimizing face component fairness: attribute label scarcity and attribute inter-dependencies, both of which limit the effectiveness of bias mitigation from previous approaches. To address these issues, we propose \textbf{B}ayesian \textbf{N}etwork-informed \textbf{M}eta \textbf{R}eweighting (BNMR), which incorporates a Bayesian Network calibrator to guide an adaptive meta-learning-based sample reweighting process. During the training process of our approach, the Bayesian Network calibrator dynamically tracks model bias and encodes prior probabilities for face component attributes to overcome the above challenges. To demonstrate the efficacy of our approach, we conduct extensive experiments on a large-scale real-world human face dataset. Our results show that BNMR is able to consistently outperform recent face bias mitigation baselines. Moreover, our results suggest a positive impact of face component fairness on the commonly considered demographic fairness (e.g., \textit{gender}). Our findings pave the way for new research avenues on face component fairness, suggesting that face component fairness could serve as a potential surrogate objective for demographic fairness. The code for our work is publicly available~\footnote{https://github.com/yliuaa/BNMR-FairCompFace.git}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。