从数据中自动推导安全关键AI系统的运行边界,提升系统可认证性。
Defining Operational Conditions for Safety-Critical AI-Based Systems from Data
- 基于多维核方法,从已有数据反推AI系统的运行环境范围
- 在模拟和航空真实场景中验证了方法的有效性与收敛性
- 支持未来安全关键AI系统的自动化认证,适合自动驾驶等领域
人工智能在众多安全关键领域应用日益广泛,但复杂现实系统中定义AI必须运行的环境条件(即运行设计域,ODD)仍极具挑战,常导致描述不完整,难以满足认证要求。传统ODD在开发早期依赖专家知识制定,本文提出一种基于已收集数据的后验ODD定义方法,采用多维核表示。该方法在合成基准和真实航空应用场景中均被验证有效,并证明了在给定假设下校准表示的体积收敛性。所提出的确定性核表示完全自动生成,具备保证输入下的置换稳定性和有界性,经仿射等变归一化后对单位选择不变,实现安全优先的设计。该方法为数据驱动的安全关键AI系统未来认证提供了支持。
原文摘要 · Abstract (English)
Artificial Intelligence (AI) has been on the rise in many domains, including numerous safety-critical applications. However, for complex systems in the real world, defining the underlying environmental conditions in which the AI-based system must operate---the Operational Design Domain (ODD)---is extremely challenging. This often results in an incomplete description of the ODD, which contrasts with the requirements of many domains for certifying AI-based systems. Traditionally, the ODD is created in the early stages of the development process, drawing on sophisticated expert knowledge and related standards. This paper presents a novel method for defining the ODD a posteriori from previously collected data using a multidimensional kernel-based representation. This approach is validated through both synthetic benchmarks and a real-world aviation use case. Moreover, the paper defines similarity of two ODDs if they generate the same outputs up to Lebesgue-null input sets and proves convergence in volume of the calibrated representation under the stated assumptions. The novel, safety-by-design, deterministic kernel-based ODD representation is derived fully automatically, given documented assurance inputs, permutation-stable, bounded by construction, and, under affine-equivariant per-dimension normalization, invariant to the choice of units. Utilizing the proposed ODD representation supports future certification of data-driven, safety-critical AI-based systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。