arXiv:2505.19860cs.RO2025-05被引 5

用因果贝叶斯网络分析复杂系统安全,融合数据与专家知识。

Causal Bayesian Networks for Data-driven Safety Analysis of Complex Systems

  • 构建因果贝叶斯网络建模系统故障传播路径
  • 提出基于佩尔框架的因果影响评估方法
  • 适用于自动驾驶等开放环境中的安全分析

确保与环境交互的安全关键复杂系统安全运行面临重大挑战,尤其当其世界模型依赖机器学习处理感知输入时。全面的安全论证需了解故障或功能不足如何在系统内传播并与其他外部因素交互,以管理其安全影响。虽然统计分析可支持安全评估,但仅靠相关性推理不足以支撑安全论证或识别安全措施。对系统及其与环境互动的因果理解至关重要,有助于知识迁移与泛化,促进潜在改进的发现。本文探索使用因果贝叶斯网络建模系统因果关系以进行安全分析,并基于佩尔的因果推断框架提出评估因果影响的方法。将该方法与成熟的故障树分析进行比较,阐述其优势与局限。特别考察故障树中常用的重要度指标,作为讨论合适因果度量的基础。以自动驾驶感知系统为例进行评估。整体而言,该工作提出了一种因果推理方法,可在开放环境中集成数据驱动与专家知识,应对复杂系统带来的不确定性。

原文摘要 · Abstract (English)

Ensuring safe operation of safety-critical complex systems interacting with their environment poses significant challenges, particularly when the system's world model relies on machine learning algorithms to process the perception input. A comprehensive safety argumentation requires knowledge of how faults or functional insufficiencies propagate through the system and interact with external factors, to manage their safety impact. While statistical analysis approaches can support the safety assessment, associative reasoning alone is neither sufficient for the safety argumentation nor for the identification and investigation of safety measures. A causal understanding of the system and its interaction with the environment is crucial for safeguarding safety-critical complex systems. It allows to transfer and generalize knowledge, such as insights gained from testing, and facilitates the identification of potential improvements. This work explores using causal Bayesian networks to model the system's causalities for safety analysis, and proposes measures to assess causal influences based on Pearl's framework of causal inference. We compare the approach of causal Bayesian networks to the well-established fault tree analysis, outlining advantages and limitations. In particular, we examine importance metrics typically employed in fault tree analysis as foundation to discuss suitable causal metrics. An evaluation is performed on the example of a perception system for automated driving. Overall, this work presents an approach for causal reasoning in safety analysis that enables the integration of data-driven and expert-based knowledge to account for uncertainties arising from complex systems operating in open environments.

因果推理安全分析贝叶斯网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。