基于真实事故数据,构建AI风险应对策略分类体系。
When AI Fails, What Works? A Data-Driven Taxonomy of Real-World AI Risk Mitigation Strategies
- 从9705篇媒体报道中提取6893个应对措施,构建新分类
- 发现4类新策略,覆盖67%新增模式,提升原有分类覆盖率
- 适合关注AI系统性风险与监管落地的从业者参考
大型语言模型正被广泛应用于高风险场景,其故障可能引发法律纠纷、声誉损失和重大财务影响。本文基于9,705篇媒体报告的AI事故数据,通过结构化提示提取6,893条具体应对措施,并系统分类扩展了MIT的AI风险缓解分类体系。研究提出四个新类别:1)纠正与限制措施,2)法律/监管与执法行动,3)金融、经济与市场调控,4)回避与否认。定量标注共生成23,994个标签,其中9,629项为此前未见的模式,使原子类别的覆盖范围提升67%。该分类体系强化了从诊断到干预的指导链条,推动持续、对齐分类的部署后监控,以预防级联故障与下游影响。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly embedded in high-stakes workflows, where failures propagate beyond isolated model errors into systemic breakdowns that can lead to legal exposure, reputational damage, and material financial losses. Building on this shift from model-centric risks to end-to-end system vulnerabilities, we analyze real-world AI incident reporting and mitigation actions to derive an empirically grounded taxonomy that links failure dynamics to actionable interventions. Using a unified corpus of 9,705 media-reported AI incident articles, we extract explicit mitigation actions from 6,893 texts via structured prompting and then systematically classify responses to extend MIT's AI Risk Mitigation Taxonomy. Our taxonomy introduces four new mitigation categories, including 1) Corrective and Restrictive Actions, 2) Legal/Regulatory and Enforcement Actions, 3) Financial, Economic, and Market Controls, and 4) Avoidance and Denial, capturing response patterns that are becoming increasingly prevalent as AI deployment and regulation evolve. Quantitatively, we label the mitigation dataset with 32 distinct labels, producing 23,994 label assignments; 9,629 of these reflect previously unseen mitigation patterns, yielding a 67% increase of the original subcategory coverage and substantially enhancing the taxonomy's applicability to emerging systemic failure modes. By structuring incident responses, the paper strengthens "diagnosis-to-prescription" guidance and advances continuous, taxonomy-aligned post-deployment monitoring to prevent cascading incidents and downstream impact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。