让模型公平化时只做最小可解释的修改,避免重复训练。
Controlled Model Debiasing through Minimal and Interpretable Updates
- 通过概念驱动+对抗学习,只对预测做最小且可解释的调整。
- 在二分类任务中,新旧模型差异小,性能媲美顶尖去偏方法。
- 无需敏感属性测试,适合医疗金融等高风险场景使用。
传统公平机器学习方法通常需从头重建模型,未考虑已有模型。频繁重训练易导致更新不一致及冗余验证成本。为此,我们提出可控模型去偏(Controlled Model Debiasing),要求新公平模型与原模型间的变化满足:(i) 最小化,(ii) 可解释。我们提出了模型无关、测试时无需敏感属性的算法 COMMOD,结合概念架构与对抗学习,在二分类任务中显式控制偏差前后预测的最小且可解释变化。理论分析提供保障,实证显示其性能接近最先进去偏方法,同时实现更小、更透明的预测调整。
原文摘要 · Abstract (English)
Traditional approaches to learning fair machine learning models often require rebuilding models from scratch, typically without considering potentially existing models. In a context where models need to be retrained frequently, this can lead to inconsistent model updates, as well as redundant and costly validation testing. To address this limitation, we introduce the notion of controlled model debiasing, a novel supervised learning task relying on two desiderata: that the differences between the new fair model and the existing one should be (i) minimal and (ii) interpretable. After providing theoretical guarantees to this new problem, we introduce a novel algorithm for algorithmic fairness, COMMOD, that is both model-agnostic and does not require the sensitive attribute at test time. In addition, our algorithm is explicitly designed to enforce minimal and interpretable changes between biased and debiased predictions in a binary classification task, a property that, while highly desirable in high-stakes applications, is rarely prioritized as an explicit objective in fairness literature. Our approach combines a concept-based architecture and adversarial learning and we demonstrate through empirical results that it achieves comparable performance to state-of-the-art debiasing methods while performing minimal and interpretable prediction changes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。