arXiv:2504.12446cs.LGcs.AI2025-04被引 4

将神经网络转化为可解释的决策树,提升AI透明度。

Deriving Equivalent Symbol-Based Decision Models from Feedforward Neural Networks

  • 通过分析神经元激活值和输入配置,逐步提取符号化决策结构。
  • 在真实数据上验证了从FNN生成等效决策树的可行性。
  • 适合关注AI可解释性与可信度的研究者与工程师。

人工智能正深刻改变各行业,但其黑箱特性阻碍了信任与采纳。本文探索连接主义与符号主义的融合,提出从前馈神经网络(FNN)中推导可解释的符号模型(如决策树)的方法。通过追踪网络各层的神经元激活值与输入配置,将激活值及其对应输入映射为决策树边,实现对FNN决策过程的有效捕捉。该方法利用FNN中的分布式表示,识别出填充物、角色及其关系,支持对深层网络的迭代子路径优化。原型系统基于Keras .h5数据,在Java JDK/JavaFX环境中模拟TensorFlow运行,成功验证了从神经网络提取符号表示的可行性,提升了AI系统的可解释性与问责性。

原文摘要 · Abstract (English)

Artificial intelligence (AI) has emerged as a transformative force across industries, driven by advances in deep learning and natural language processing, and fueled by large-scale data and computing resources. Despite its rapid adoption, the opacity of AI systems poses significant challenges to trust and acceptance. This work explores the intersection of connectionist and symbolic approaches to artificial intelligence, focusing on the derivation of interpretable symbolic models, such as decision trees, from feedforward neural networks (FNNs). Decision trees provide a transparent framework for elucidating the operations of neural networks while preserving their functionality. The derivation is presented in a step-by-step approach and illustrated with several examples. A systematic methodology is proposed to bridge neural and symbolic paradigms by exploiting distributed representations in FNNs to identify symbolic components, including fillers, roles, and their interrelationships. The process traces neuron activation values and input configurations across network layers, mapping activations and their underlying inputs to decision tree edges. The resulting symbolic structures effectively capture FNN decision processes and enable scalability to deeper networks through iterative refinement of subpaths for each hidden layer. To validate the theoretical framework, a prototype was developed using Keras .h5-data and emulating TensorFlow within the Java JDK/JavaFX environment. This prototype demonstrates the feasibility of extracting symbolic representations from neural networks, enhancing trust in AI systems, and promoting accountability.

可解释AI神经网络决策树

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。