让神经符号系统自动演化出无法微分的推理规则,无需专家先验知识。
Neural-Symbolic Integration with Evolvable Policies
- 用进化算法同时优化符号规则和神经网络权重,支持非可微策略。
- 从空规则和随机权重开始,中位正确率逼近100%。
- 适合符号知识难获取的领域,如复杂逻辑推理或新场景建模。
神经符号(NeSy)人工智能结合了神经网络的学习能力与符号系统的可解释性推理,但现有框架通常依赖预定义或可微分的符号策略,限制了在缺乏领域专家知识或策略本身不可微时的应用。本文提出一种新框架,通过进化过程实现非可微符号策略与神经网络权重的同步学习。将NeSy系统视为种群中的有机体,通过符号规则增删和神经权重变异进行演化,以适应度选择推动收敛至隐藏目标策略。该框架扩展了NEUROLOG架构使符号策略可训练,适配Valiant的可演化性理论至NeSy场景,并采用机器辅导语义处理可变符号表示。神经网络通过符号组件的溯因推理进行训练,不再要求可微性。大量实验表明,从空策略和随机权重起始的系统能成功逼近隐藏的非可微目标策略,中位正确率接近100%。本工作推进了在难以获取符号知识的领域中开展NeSy研究的可能性。
原文摘要 · Abstract (English)
Neural-Symbolic (NeSy) Artificial Intelligence has emerged as a promising approach for combining the learning capabilities of neural networks with the interpretable reasoning of symbolic systems. However, existing NeSy frameworks typically require either predefined symbolic policies or policies that are differentiable, limiting their applicability when domain expertise is unavailable or when policies are inherently non-differentiable. We propose a framework that addresses this limitation by enabling the concurrent learning of both non-differentiable symbolic policies and neural network weights through an evolutionary process. Our approach casts NeSy systems as organisms in a population that evolve through mutations (both symbolic rule additions and neural weight changes), with fitness-based selection guiding convergence toward hidden target policies. The framework extends the NEUROLOG architecture to make symbolic policies trainable, adapts Valiant's Evolvability framework to the NeSy context, and employs Machine Coaching semantics for mutable symbolic representations. Neural networks are trained through abductive reasoning from the symbolic component, eliminating differentiability requirements. Through extensive experimentation, we demonstrate that NeSy systems starting with empty policies and random neural weights can successfully approximate hidden non-differentiable target policies, achieving median correct performance approaching 100%. This work represents a step toward enabling NeSy research in domains where the acquisition of symbolic knowledge from experts is challenging or infeasible.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。