arXiv:2410.14219cs.AIcs.LG2024-10被引 8

提出一套形式化方法,让神经符号系统决策过程更透明可解释。

Formal Explanations for Neuro-Symbolic AI

  • 分层解析:先解释符号部分,再聚焦需说明的神经输入
  • 相比纯神经模型,解释更短、更快、训练更省
  • 适合需要可信推理的高阶任务,如医疗诊断或金融风控

尽管人工智能在实践中取得成功,当前神经网络算法仍存在两大问题:决策易受偏见影响且脆弱;涉及链式推理时表现不佳。神经符号人工智能通过融合神经感知与符号推理,有望解决这些缺陷。随着AI应用日益关键,理解其行为变得至关重要,催生了可解释AI(XAI)的发展。然而,神经符号系统的决策因神经与符号组件的交互而难以解释。本文提出一种形式化解释方法,基于形式反事实解释,并分层求解神经符号可解释性问题:先为符号组件生成正式解释,以确定需解释的神经信息子集;再独立解释这些特定神经输入,提升解释简洁性并增强整体性能。实验在多个复杂推理任务中验证了该方法的有效性,相较于纯神经系统,在解释长度、解释时间、训练时间、模型规模及解释质量方面均表现出显著优势。

原文摘要 · Abstract (English)

Despite the practical success of Artificial Intelligence (AI), current neural AI algorithms face two significant issues. First, the decisions made by neural architectures are often prone to bias and brittleness. Second, when a chain of reasoning is required, neural systems often perform poorly. Neuro-symbolic artificial intelligence is a promising approach that tackles these (and other) weaknesses by combining the power of neural perception and symbolic reasoning. Meanwhile, the success of AI has made it critical to understand its behaviour, leading to the development of explainable artificial intelligence (XAI). While neuro-symbolic AI systems have important advantages over purely neural AI, we still need to explain their actions, which are obscured by the interactions of the neural and symbolic components. To address the issue, this paper proposes a formal approach to explaining the decisions of neuro-symbolic systems. The approach hinges on the use of formal abductive explanations and on solving the neuro-symbolic explainability problem hierarchically. Namely, it first computes a formal explanation for the symbolic component of the system, which serves to identify a subset of the individual parts of neural information that needs to be explained. This is followed by explaining only those individual neural inputs, independently of each other, which facilitates succinctness of hierarchical formal explanations and helps to increase the overall performance of the approach. Experimental results for a few complex reasoning tasks demonstrate practical efficiency of the proposed approach, in comparison to purely neural systems, from the perspective of explanation size, explanation time, training time, model sizes, and the quality of explanations reported.

可解释AI神经符号形式化解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。