首次对交易反欺诈模型进行公平性审计,揭示了偏见来源与缓解难点。
Evaluating Fairness in Transaction Fraud Models: Fairness Metrics, Bias Audits, and Challenges
- 用合成数据集系统评估公平性,关注不平衡数据影响。
- 去除敏感属性无法降低偏见,因存在相关代理变量。
- 需兼顾风控与服务质量,避免简单化公平策略。
确保交易反欺诈模型的公平性至关重要,因其决策偏差可能带来实际伤害和法律风险。尽管算法公平性研究广泛,但欺诈检测领域的偏见研究仍显著不足,主要源于该领域特有的挑战:需设计能应对欺诈数据严重不平衡的公平性度量,同时平衡反欺诈保护与服务体验。为此,我们利用公开合成数据集,首次开展该领域的系统性公平性评估。结果揭示三点关键发现:(1)某些公平性度量仅在归一化后才显现出显著偏见,凸显类别不平衡的影响;(2)偏见存在于服务品质相关与欺诈防护相关的各类公平性指标中;(3)移除性别等敏感属性的“无意识”方法未能改善偏见,很可能是由于存在相关代理变量。我们还讨论了该领域存在的社会技术性公平挑战。这些发现强调,反欺诈公平性需权衡保护与服务质量,不能仅依赖简单偏见缓解策略。未来工作应聚焦于优化度量标准,并开发适配该领域复杂性的专门方法。
原文摘要 · Abstract (English)
Ensuring fairness in transaction fraud detection models is vital due to the potential harms and legal implications of biased decision-making. Despite extensive research on algorithmic fairness, there is a notable gap in the study of bias in fraud detection models, mainly due to the field's unique challenges. These challenges include the need for fairness metrics that account for fraud data's imbalanced nature and the tradeoff between fraud protection and service quality. To address this gap, we present a comprehensive fairness evaluation of transaction fraud models using public synthetic datasets, marking the first algorithmic bias audit in this domain. Our findings reveal three critical insights: (1) Certain fairness metrics expose significant bias only after normalization, highlighting the impact of class imbalance. (2) Bias is significant in both service quality-related parity metrics and fraud protection-related parity metrics. (3) The fairness through unawareness approach, which involved removing sensitive attributes such as gender, does not improve bias mitigation within these datasets, likely due to the presence of correlated proxies. We also discuss socio-technical fairness-related challenges in transaction fraud models. These insights underscore the need for a nuanced approach to fairness in fraud detection, balancing protection and service quality, and moving beyond simple bias mitigation strategies. Future work must focus on refining fairness metrics and developing methods tailored to the unique complexities of the transaction fraud domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。