通过用户反馈引导模型关注性别分类相关特征,减轻视觉性别识别中的偏见。
Explanatory Interactive Machine Learning for Bias Mitigation in Visual Gender Classification
- 利用用户对解释的反馈,引导模型聚焦于用户认为相关的图像特征。
- 使用CAIPI方法可降低男女误分类率差异,提升公平性,且可能提升准确率。
- 该方法增强模型透明度,适合需保障公平性的视觉性别识别场景。
解释性交互学习(XIL)使用户可通过反馈模型解释来引导机器学习模型训练,从而让模型关注用户视角下与预测相关的特征。本研究探索该范式在缓解视觉分类器中偏见和虚假相关性方面的潜力,特别是在易受数据偏见影响的性别分类任务中。我们评估了两种先进的XIL策略——CAIPI与右因正确(RRR),以及一种结合两者的新型混合方法。通过对比梯度加权类激活映射(GradCAM)和有界逻辑注意力(BLA)生成的分割掩码进行定量评估。实验表明,这些方法能有效引导模型关注相关图像特征,尤其在使用CAIPI时效果显著;同时减少模型偏见,平衡男性与女性预测的误分类率。分析进一步支持XIL提升性别分类公平性的潜力。总体而言,尽管透明度和公平性提升带来轻微性能下降,但CAIPI表现出提升分类准确率的潜力。
原文摘要 · Abstract (English)
Explanatory interactive learning (XIL) enables users to guide model training in machine learning (ML) by providing feedback on the model's explanations, thereby helping it to focus on features that are relevant to the prediction from the user's perspective. In this study, we explore the capability of this learning paradigm to mitigate bias and spurious correlations in visual classifiers, specifically in scenarios prone to data bias, such as gender classification. We investigate two methodologically different state-of-the-art XIL strategies, i.e., CAIPI and Right for the Right Reasons (RRR), as well as a novel hybrid approach that combines both strategies. The results are evaluated quantitatively by comparing segmentation masks with explanations generated using Gradient-weighted Class Activation Mapping (GradCAM) and Bounded Logit Attention (BLA). Experimental results demonstrate the effectiveness of these methods in (i) guiding ML models to focus on relevant image features, particularly when CAIPI is used, and (ii) reducing model bias (i.e., balancing the misclassification rates between male and female predictions). Our analysis further supports the potential of XIL methods to improve fairness in gender classifiers. Overall, the increased transparency and fairness obtained by XIL leads to slight performance decreases with an exception being CAIPI, which shows potential to even improve classification accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。