让复杂场景的致命原因可解释、可追溯,提升系统安全测试效率。
NeSy-CSA: A Neuro-Symbolic Framework for Open-Ended Critical Scenario Attribution

- 结合神经与符号方法,构建可追踪的推理图谱来定位关键因素。
- 在4个环境中使解释有效性提升18.32%和13.67%,优于大模型基线。
- 适合需要高可信度解释的安全系统测试与故障分析场景。
理解发现的场景为何在基于场景的测试中变得关键,对有效利用其决策系统至关重要。将此类关键性推理建模为归因问题。然而,在不同决策任务中,关键性的成因可能涉及多样的状态变量、交互模式和失效机制,使归因成为一个本质上的开放性问题,超出预定义解释空间。现有归因方法仍难以在开放性推理灵活性与关键场景推理所需的可解释性和可追溯性之间取得平衡。为此,我们提出NeSy-CSA,一种神经符号框架,将开放性关键场景归因从无约束解释生成转变为结构化、可追溯的推理过程。NeSy-CSA通过选择相关因素缩小归因空间,利用依赖感知证据图实现推理可追溯,并通过原子操作导出的符号推理流程,与证据约束的神经推断协同,支持灵活的开放性归因。我们进一步引入过程级与结果级评估模块,以评估归因过程的结构性有效性及归因结果在受控干预下的行为有效性。在四个决策环境中的实验表明,NeSy-CSA在两项基于干预的归因有效性指标上分别比基于大模型的基线提高18.32%和13.67%。这些结果证明其将发现的关键场景转化为后续测试与安全分析可复用知识的潜力。
原文摘要 · Abstract (English)
Understanding why discovered scenarios become critical in scenario-based testing is essential for effectively leveraging them in decision-making systems. Reasoning about such criticality can be formulated as an attribution problem. However, across different decision-making tasks, the causes of criticality may involve diverse state variables, interaction patterns, and failure mechanisms, making attribution an inherently open-ended problem beyond predefined explanation spaces. Existing attribution methods still struggle to balance open-ended reasoning flexibility with the interpretability and traceability required for critical scenario reasoning. To address this limitation, we propose NeSy-CSA, a neuro-symbolic framework that transforms open-ended critical scenario attribution from unconstrained explanation generation into structured and traceable reasoning. NeSy-CSA narrows the attribution space by selecting relevant factors, makes the reasoning process traceable through a dependency-aware evidence graph, and executes symbolic reasoning procedures derived from atomic operations, coordinated with evidence-constrained neural inference to support flexible open-ended attribution. We further introduce a process-level and result-level assessment module to evaluate the structural validity of the attribution process and the behavioral effectiveness of the attribution results under controlled interventions. Experiments across four decision-making environments show that NeSy-CSA improves two intervention-based measures of attribution effectiveness by 18.32% and 13.67% over LLM-based baselines. These results demonstrate its potential to transform discovered critical scenarios into reusable knowledge for subsequent testing and safety analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。