5300起AI事故报告揭示:多重身份叠加才会放大伤害,单一身份评估无效。
Why AI Harms Can't Be Fixed One Identity at a Time: What 5300 Incident Reports Reveal About Intersectionality

- 用大语言模型分析5300份事故报告,识别出1513名受害者及身份特征
- 年龄与政治立场的伤害发生率接近种族和性别,特定交叉群体伤害翻3倍
- 强调必须将交叉性纳入风险评估,否则无法真实反映伤害分布
AI风险评估是识别AI系统造成危害的主要工具。其中交叉性伤害源于身份类别(如阶级与肤色)的相互作用,单独考虑任一类别时不会出现或表现不同。然而现有评估仍以孤立身份类别为基础,且交叉性分析几乎仅限于种族与性别。基于对AI事件数据库中1200起已记录事件的5300份报告的大型分析,我们发现AI伤害并非按单一身份类别发生。通过结构化评分框架结合大语言模型,我们准确识别出1513名受害主体及其身份属性,准确率达98%。在单个类别层面,年龄与政治身份的伤害频率与种族、性别相当;在交叉层面,青少年女性、低收入有色人群、高收入政治精英等组合的伤害程度最高可达三倍。我们主张将交叉性作为AI风险评估的核心,以更准确捕捉伤害的产生与分布机制。
原文摘要 · Abstract (English)
AI risk assessment is the primary tool for identifying harms caused by AI systems. These include intersectional harms, which arise from the interaction between identity categories (e.g., class and skin tone) and which do not occur, or occur differently, when those categories are considered separately. Yet existing AI risk assessments are still built around isolated identity categories, and when intersections are considered, they focus almost exclusively on race and gender. Drawing on a large-scale analysis of documented AI incidents, we show that AI harms do not occur one identity category at a time. Using a structured rubric applied with a Large Language Model (LLM), we analyze 5,300 reports from 1,200 documented incidents in the AI Incident Database, the most curated source of incident data. From these reports, we identify 1,513 harmed subjects and their associated identity categories, achieving 98% accuracy. At the level of individual categories, we find that age and political identity appear in documented AI harms at rates comparable to race and gender. At the level of intersecting categories, harm is amplified up to three times at specific intersections: adolescent girls, lower-class people of color, and upper-class political elites. We argue that intersectionality should be a core component of AI risk assessment to more accurately capture how harms are produced and distributed across social groups.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。