arXiv:2606.12435cs.CYcs.DB2026-06

用关联规则检测房贷审批中的隐性歧视,发现公平分箱代价高但能发现群体差异。

Auditing Discriminatory Patterns in Mortgage Lending Through Association Rules and Fair Binning

论文配图:Auditing Discriminatory Patterns in Mortgage Lending Through Association Rules and Fair Binning
图 1 · 摘自论文原文
  • 对比标准分箱与公平分箱,用关联规则挖掘审批模式
  • 黑人申请者在财务相似群体中仍被更高比例拒贷
  • 公平分箱成本显著,但可识别隐藏的系统性偏见

美国房贷审批存在持续的种族与性别差异。本文研究标准数据预处理中的属性分箱是否会加剧下游模式挖掘中的不公平现象。基于2023年HMDA芝加哥大都市区的103,481份清洗后贷款申请数据,构建三阶段流程:(1) 使用PySpark实现等频分箱与Asudeh等人[1]提出的epsilon-偏差公平分箱算法;(2) 采用FP-Growth进行关联规则挖掘,比较两种分箱方式下的拒贷模式;(3) 结合K-Means聚类与每簇的差异影响审计。结果显示,标准分箱在收入离散化中存在9.63%的种族偏见,与以往8-10%的研究结果一致。在epsilon=0.03时,七种族群的公平分箱不可行,仅在epsilon=0.08下成功,代价为29.4%。FP-Growth发现债务收入比是主要拒贷因素(置信度67.2%,提升2.81),但未产生显式的种族高支持规则。然而,聚类后的差异影响审计识别出45个簇-组配对中的10个,表明即使在财务条件相似的情况下,黑人申请者的拒贷率仍显著高于白人。

原文摘要 · Abstract (English)

Mortgage lending in the United States exhibits persistent racial and gender disparities. We investigate whether standard data preprocessing steps, specifically attribute binning, amplify these disparities in downstream pattern mining. Using 103,481 cleaned mortgage applications from the HMDA 2023 dataset (Chicago metropolitan area), we build a three-stage pipeline: (1) a PySpark data cleaning and binning pipeline that implements both standard equal-frequency binning and the epsilon-biased fair binning algorithm from Asudeh et al. [1], (2) FP-Growth association rule mining that compares denial patterns under both binning regimes, and (3) K-Means clustering with a per-cluster disparate impact audit. Our standard binning shows 9.63% racial bias in income discretization, consistent with the 8-10% reported in prior work. Fair binning with seven race groups is infeasible at epsilon=0.03 and only succeeds at epsilon=0.08 with a Price of Fairness of 29.4%. FP-Growth reveals that high debt-to-income ratio is the dominant denial predictor (67.2% confidence, 2.81 lift), while racial bias does not appear as explicit high-support rules. However, K-Means clustering followed by a disparate impact audit flags 10 out of 45 cluster-group pairs, showing that Black applicants face significantly higher denial rates than White applicants even among financially similar groups.

公平学习数据分箱信贷公平关联规则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。