用可能性规则系统融合神经网络,解释图像识别结果。
$Π$-NeSy: A Possibilistic Neuro-Symbolic Approach
- 神经网络输出转为可能性分布,驱动符号推理
- 在手写数字加法与数独任务中优于现有方法
- 适合需要可解释性的图像分类场景
本文提出一种神经符号方法,将神经网络的低层感知任务与基于可能性规则的高层推理任务结合,旨在为每个输入实例推断其属于目标(元)概念的可能性程度。该(元)概念通过中间概念与规则系统关联,输入实例中各中间概念的可能性由神经网络推断得出。低层感知与高层推理的连接在于将神经网络输出(经softmax激活)转化为可能性分布。引入中间概念有助于解释:可通过已识别的中间概念来说明输入被归类为目标概念的原因。技术上,本文设计了高效方法以构建可能性规则系统的矩阵关系和方程组,这些是进行推理及根据训练样本学习规则参数的关键数据结构。此外,利用近期关于模糊关系方程不一致系统处理的研究成果,提出一种基于多个训练样本学习规则参数的方法。在MNIST加法问题和MNIST数独问题上的实验表明,本方法在性能上优于现有顶尖神经符号方法。
原文摘要 · Abstract (English)
In this article, we introduce a neuro-symbolic approach that combines a low-level perception task performed by a neural network with a high-level reasoning task performed by a possibilistic rule-based system. The goal is to be able to derive for each input instance the degree of possibility that it belongs to a target (meta-)concept. This (meta-)concept is connected to intermediate concepts by a possibilistic rule-based system. The probability of each intermediate concept for the input instance is inferred using a neural network. The connection between the low-level perception task and the high-level reasoning task lies in the transformation of neural network outputs modeled by probability distributions (through softmax activation) into possibility distributions. The use of intermediate concepts is valuable for the explanation purpose: using the rule-based system, the classification of an input instance as an element of the (meta-)concept can be justified by the fact that intermediate concepts have been recognized. From the technical side, our contribution consists of the design of efficient methods for defining the matrix relation and the equation system associated with a possibilistic rule-based system. The corresponding matrix and equation are key data structures used to perform inferences from a possibilistic rule-based system and to learn the values of the rule parameters in such a system according to a training data sample. Furthermore, leveraging recent results on the handling of inconsistent systems of fuzzy relational equations, an approach for learning rule parameters according to multiple training data samples is presented. Experiments carried out on the MNIST addition problems and the MNIST Sudoku puzzles problems highlight the effectiveness of our approach compared with state-of-the-art neuro-symbolic ones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。