用简单输入实现AI系统合规风险自检,助力符合欧盟《人工智能法案》。
TAI Scan Tool: A RAG-Based Tool With Minimalistic Input for Trustworthy AI Self-Assessment
- 基于RAG技术,分预筛与评估两步完成AI风险自检。
- 能准确判断风险等级并检索相关法规条文,覆盖三大语义类别。
- 适合需要快速合规的开发者或企业法务人员使用。
本文提出TAI Scan Tool,一种基于RAG的可信AI自评估工具,仅需极简输入即可完成法律合规性评估,重点支持欧盟《人工智能法案》(AI Act)要求。工具采用两阶段流程:预筛选与正式评估。评估结果可输出AI系统的风险等级,并检索相关法规条文以辅助合规,明确责任义务。通过三类使用场景的定性评估,工具在风险等级判断和跨语义类别条文检索方面表现良好。分析显示,其推理机制依赖于与高风险系统设定的对比,这正是《人工智能法案》中频繁强调的考量因素。
原文摘要 · Abstract (English)
This paper introduces the TAI Scan Tool, a RAG-based TAI self-assessment tool with minimalistic input. The current version of the tool supports the legal TAI assessment, with a particular emphasis on facilitating compliance with the AI Act. It involves a two-step approach with a pre-screening and an assessment phase. The assessment output of the system includes insight regarding the risk-level of the AI system according to the AI Act, while at the same time retrieving relevant articles to aid with compliance and notify on their obligations. Our qualitative evaluation using use-case scenarios yields promising results, correctly predicting risk levels while retrieving relevant articles across three distinct semantic groups. Furthermore, interpretation of results shows that the tool's reasoning relies on comparison with the setting of high-risk systems, a behaviour attributed to their deployment requiring careful consideration, and therefore frequently presented within the AI Act.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。