arXiv:2507.23669cs.CYcs.AI2025-07中稿 · the 28th European …被引 3

用语义匹配自动关联AI事故报告,提升数据库维护效率。

Automating AI Failure Tracking: Semantic Association of Reports in AI Incident Database

  • 通过嵌入向量计算报告与历史事故的相似度,实现自动化关联。
  • 结合标题和描述比仅用标题准确率显著提升,最长支持2000字文本。
  • 数据越多效果越好,适合持续更新的AI事故追踪系统使用。

人工智能系统正广泛应用于医疗、金融、交通等关键领域,提升效率与决策能力,但其在高风险场景中的部署暴露了潜在漏洞,可能引发重大社会危害。为系统性研究并缓解此类风险,AI事故数据库(AIID)已收录超过3,000条真实世界中的AI失败报告。当前,将新报告归类到对应事故仍依赖人工专家判断,限制了可扩展性并延迟了新兴故障模式的识别。为此,我们提出一种基于检索的框架,通过语义相似性建模实现新报告与已有事故的自动化关联。我们将该任务形式化为排序问题,以报告标题和全文描述为基础,通过嵌入向量的余弦相似度进行比较。在传统词法方法、交叉编码器架构及Transformer句向量模型的对比中,后者表现更优。分析表明,融合标题与描述可显著提高排序准确率,优于仅使用标题。此外,检索性能在描述长度变化下保持稳定,体现框架鲁棒性。最后,随着训练集扩大,检索性能持续提升。本方法为AIID的高效维护提供了可扩展解决方案。

原文摘要 · Abstract (English)

Artificial Intelligence (AI) systems are transforming critical sectors such as healthcare, finance, and transportation, enhancing operational efficiency and decision-making processes. However, their deployment in high-stakes domains has exposed vulnerabilities that can result in significant societal harm. To systematically study and mitigate these risk, initiatives like the AI Incident Database (AIID) have emerged, cataloging over 3,000 real-world AI failure reports. Currently, associating a new report with the appropriate AI Incident relies on manual expert intervention, limiting scalability and delaying the identification of emerging failure patterns. To address this limitation, we propose a retrieval-based framework that automates the association of new reports with existing AI Incidents through semantic similarity modeling. We formalize the task as a ranking problem, where each report-comprising a title and a full textual description-is compared to previously documented AI Incidents based on embedding cosine similarity. Benchmarking traditional lexical methods, cross-encoder architectures, and transformer-based sentence embedding models, we find that the latter consistently achieve superior performance. Our analysis further shows that combining titles and descriptions yields substantial improvements in ranking accuracy compared to using titles alone. Moreover, retrieval performance remains stable across variations in description length, highlighting the robustness of the framework. Finally, we find that retrieval performance consistently improves as the training set expands. Our approach provides a scalable and efficient solution for supporting the maintenance of the AIID.

AI安全事故追踪语义检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。