用神经因果模型生成更真实的反事实样本,提升公平性建模效果
Learning Counterfactually Fair Models via Improved Generation with Neural Causal Models
- 采用神经因果模型生成反事实数据,结合核最小二乘损失确保因果一致性
- 提出基于MMD的正则项,在训练中直接约束反事实公平性,提升公平与泛化平衡
- 适用于需严格公平性保障的决策系统,如信贷、招聘等场景
机器学习应用中的公平性问题备受关注,反事实公平性作为直观自然的公平定义逐渐兴起。然而现有方法存在两大局限:一是生成的反事实样本难以忠实于底层因果图;二是现有正则化手段仅为代理,未直接实现反事实公平性的精确定义。本文旨在解决这两方面问题。首先,提出使用神经因果模型(NCMs)生成反事实样本,并针对其后验估计误差导致的$<L_3>$一致性无法保证的问题,设计一种新的核最小二乘损失项,显式强制满足$<L_3>$约束,从而获得更优的反事实生成能力。其次,提出一种基于最大均值差异(MMD)的正则化项,在训练过程中直接施加反事实公平性条件。实验表明,该方法在合成数据集和基准数据集上实现了比现有基线更好的反事实公平性与泛化能力之间的权衡。
原文摘要 · Abstract (English)
One of the main concerns while deploying machine learning models in real-world applications is fairness. Counterfactual fairness has emerged as an intuitive and natural definition of fairness. However, existing methodologies for enforcing counterfactual fairness seem to have two limitations: (i) generating counterfactual samples faithful to the underlying causal graph, and (ii) as we argue in this paper, existing regularizers are mere proxies and do not directly enforce the exact definition of counterfactual fairness. In this work, our aim is to mitigate both issues. Firstly, we propose employing Neural Causal Models (NCMs) for generating the counterfactual samples. For implementing the abduction step in NCMs, the posteriors of the exogenous variables need to be estimated given a counterfactual query, as they are not readily available. As a consequence, $\mathcal{L}_3$ consistency with respect to the underlying causal graph cannot be guaranteed in practice due to the estimation errors involved. To mitigate this issue, we propose a novel kernel least squares loss term that enforces the $\mathcal{L}_3$ constraints explicitly. Thus, we obtain an improved counterfactual generation suitable for the counterfactual fairness task. Secondly, we propose a new MMD-based regularizer term that explicitly enforces the counterfactual fairness conditions into the base model while training. We show an improved trade-off between counterfactual fairness and generalization over existing baselines on synthetic and benchmark datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。