arXiv:2502.05286cs.LG2025-02AAAI被引 6

不枚举模型,用数学规划精准分析公平性与稀疏性的权衡。

Fairness and Sparsity within Rashomon sets: Enumeration-Free Exploration and Characterization

  • 基于数学规划,无需枚举直接刻画好模型集内属性
  • 在误差小于1%时,公平性可从极优到极差自由调整
  • 稀疏约束会限制选择空间,可能不公平地影响特定群体

我们提出一种基于数学规划的非枚举方法,精确刻画“好模型”集合(即Rashomon集)内的公平性、稀疏性等属性。该方法适用于任何存在数学建模基础的假设类,提供结构化框架以定义业务必要性,并评估公平性在特定受保护群体上的改善或恶化情况,同时保持任意指定的稀疏水平。我们在评分系统和决策图两类假设类上应用该方法,利用近期提出的数学规划训练公式。实验表明,该方法能全面且可证明地量化预测性能、稀疏性与公平性之间的权衡。在保持低于1%最佳训练准确率损失的前提下,公平性可在显著有利到明显不利之间广泛调节;同时发现,稀疏性约束会限制这种调节能力,并可能对特定子群体造成不成比例的影响。充分表征这些关键因素间的张力,对模型的知情与问责选择至关重要。

原文摘要 · Abstract (English)

We introduce an enumeration-free method based on mathematical programming to precisely characterize various properties such as fairness or sparsity within the set of "good models", known as Rashomon set. This approach is generically applicable to any hypothesis class, provided that a mathematical formulation of the model learning task exists. It offers a structured framework to define the notion of business necessity and evaluate how fairness can be improved or degraded towards a specific protected group, while remaining within the Rashomon set and maintaining any desired sparsity level. We apply our approach to two hypothesis classes: scoring systems and decision diagrams, leveraging recent mathematical programming formulations for training such models. As seen in our experiments, the method comprehensively and certifiably quantifies trade-offs between predictive performance, sparsity, and fairness. We observe that a wide range of fairness values are attainable, ranging from highly favorable to significantly unfavorable for a protected group, while staying within less than 1% of the best possible training accuracy for the hypothesis class. Additionally, we observe that sparsity constraints limit these trade-offs and may disproportionately harm specific subgroups. As we evidenced, thoroughly characterizing the tensions between these key aspects is critical for an informed and accountable selection of models.

公平性稀疏性模型选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。