提出可统一建模多种神经符号系统的深度逻辑机器框架
The DeepLog Neurosymbolic Machine
- 用带注释的接地一阶逻辑扩展神经网络,抽象通用符号机制
- 支持模糊/概率逻辑对比,验证在架构或损失中使用逻辑的差异
- 基于GPU的代数电路实现,适合研究者快速构建不同神经符号系统
我们提出了一个名为DeepLog的神经符号AI理论与操作框架。DeepLog引入了神经符号AI的构建模块和原语,抽象了常见表示与计算机制。该框架可表征并模拟多种神经符号系统,包含两个核心组件:一是用于指定神经符号模型与推理任务的DeepLog语言,它是带注释的接地一阶逻辑的神经扩展,能抽象逻辑类型(如布尔、模糊或概率)以及逻辑在架构或损失函数中的使用方式;二是位于计算层面的扩展代数电路,作为计算图。两者共同构成神经符号抽象机,其中语言层为抽象中间层,电路层为计算层。DeepLog已实现于软件,依托最新GPU上代数电路的实现技术,具有声明式特性,通过选择不同的代数结构与逻辑即可轻松生成不同神经符号模型。其通用性与高效性通过三组实验验证:1)不同模糊与概率逻辑的比较;2)逻辑在架构中与在损失函数中使用的对比;3)独立CPU实现与DeepLog GPU实现的对比。
原文摘要 · Abstract (English)
We contribute a theoretical and operational framework for neurosymbolic AI called DeepLog. DeepLog introduces building blocks and primitives for neurosymbolic AI that make abstraction of commonly used representations and computational mechanisms in neurosymbolic AI. DeepLog can represent and emulate a wide range of neurosymbolic systems. It consists of two key components. The first is the DeepLog language for specifying neurosymbolic models and inference tasks. This language consists of an annotated neural extension of grounded first-order logic, and makes abstraction of the type of logic, e.g. Boolean, fuzzy or probabilistic, and whether logic is used in the architecture or in the loss function. The second DeepLog component is situated at the computational level and uses extended algebraic circuits as computational graphs. Together these two components are to be considered as a neurosymbolic abstract machine, with the DeepLog language as the intermediate level of abstraction and the circuits level as the computational one. DeepLog is implemented in software, relies on the latest insights in implementing algebraic circuits on GPUs, and is declarative in that it is easy to obtain different neurosymbolic models by making different choices for the underlying algebraic structures and logics. The generality and efficiency of the DeepLog neurosymbolic machine is demonstrated through an experimental comparison between 1) different fuzzy and probabilistic logics, 2) between using logic in the architecture or in the loss function, and 3) between a standalone CPU-based implementation of a neurosymbolic AI system and a DeepLog GPU-based one.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。