arXiv:2409.03632cs.LG2024-09被引 20

机器学习决策背后的社会结构因素,需超越模型解释。

Beyond Model Interpretability: Socio-Structural Explanations in Machine Learning

  • 从社会哲学视角提出'社会结构解释'新范式
  • 揭示医疗算法偏见源于社会结构性因素
  • 适合关注算法公平与社会影响的研究者

解释黑箱机器学习模型的输出,传统方法聚焦于模型内部机制或输入-输出关系。本文借鉴社会哲学,提出在具有重要规范意义的领域中,需引入第三类解释——社会结构解释。该解释强调机器学习模型并非孤立存在,而是嵌入并受制于社会结构。通过分析一个存在种族偏见的医疗资源分配算法,本文证明社会结构因素可部分解释模型输出。研究呼吁透明性应超越模型可解释性,需深入理解模型所处的社会背景。

原文摘要 · Abstract (English)

What is it to interpret the outputs of an opaque machine learning model. One approach is to develop interpretable machine learning techniques. These techniques aim to show how machine learning models function by providing either model centric local or global explanations, which can be based on mechanistic interpretations revealing the inner working mechanisms of models or nonmechanistic approximations showing input feature output data relationships. In this paper, we draw on social philosophy to argue that interpreting machine learning outputs in certain normatively salient domains could require appealing to a third type of explanation that we call sociostructural explanation. The relevance of this explanation type is motivated by the fact that machine learning models are not isolated entities but are embedded within and shaped by social structures. Sociostructural explanations aim to illustrate how social structures contribute to and partially explain the outputs of machine learning models. We demonstrate the importance of sociostructural explanations by examining a racially biased healthcare allocation algorithm. Our proposal highlights the need for transparency beyond model interpretability, understanding the outputs of machine learning systems could require a broader analysis that extends beyond the understanding of the machine learning model itself.

模型解释算法公平社会影响

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。