arXiv:2602.06984cs.CYcs.AI2026-02

让受影响者参与公平性评估,设计工具帮他们定义自己的公平标准。

Empowering Affected Individuals to Shape AI Fairness Assessments: Processes, Criteria, and Tools

  • 通过交互原型引导18名参与者将公平观念转化为可量化标准。
  • 发现个体定义的公平标准涵盖结果与程序公平,且基于具体模型特征。
  • 为设计更包容的AI评估工具提供实证依据,适合政策制定与伦理设计者。

人工智能系统在信贷评级等高风险领域应用日益广泛,公平性问题至关重要。现有评估多由专家或监管机构使用预设保护属性和指标进行,难以捕捉受决策影响个体的真实公平认知。尽管已有研究呼吁纳入受影响者参与评估,但缺乏实证证据说明他们如何形成自身公平标准,以及具体生成哪些标准——这些知识不仅有助于专家评估与缓解偏见,也能指导评估工具的设计。本研究通过一项定性用户研究,在信贷评级场景中对18名参与者展开调查:参与者首先用自身语言描述公平观念,随后借助我们设计的交互原型,将其转化为可量化、可操作的公平标准。研究发现,人们公平观念的形成依托于模型特征的具象化理解,且产生了多样化的自定义标准,覆盖结果公平与程序公平两个维度。研究提出支持更具包容性与价值敏感性的AI公平性评估过程与工具的设计启示。

原文摘要 · Abstract (English)

AI systems are increasingly used in high-stakes domains such as credit rating, where fairness concerns are critical. Existing fairness assessments are typically conducted by AI experts or regulators using predefined protected attributes and metrics, which often fail to capture the diversity and nuance of fairness notions held by the individuals who are affected by these systems' decisions, such as decision subjects. Recent work has therefore called for involving affected individuals in fairness assessment, yet little empirical evidence exists on how they create their own fairness criteria or what kinds of criteria they produce - knowledge that could not only inform experts' fairness evaluation and mitigation, but also guide the design of AI assessment tools. We address this gap through a qualitative user study with 18 participants in a credit rating scenario. Participants first articulated their fairness notions in their own words. Then, participants turned them into concrete quantified and operationalized fairness criteria, through an interactive prototype we designed. Our findings provide empirical evidence of the process through which people's fairness notions emerge via grounding in model features, and uncover a diverse set of individuals' custom-defined criteria for both outcome and procedural fairness. We provide design implications for processes and tools that support more inclusive and value-sensitive AI fairness assessment.

AI公平性用户研究交互设计信贷评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。