arXiv:2412.14814cs.AIcs.LG2024-12被引 6

用图神经网络让逻辑编程跑在GPU上,提速数十倍

Answer Set Networks: Casting Answer Set Programming into Deep Learning

  • 用图神经网络构建可训练的逻辑求解器,替代传统慢速求解器
  • 在多个任务上比现有系统快10-50倍,且支持批量并行计算
  • 适合需要强逻辑约束的AI系统,如自动驾驶、语言模型对齐

尽管答案集编程(ASP)能为神经符号系统提供约束,但其应用受限于稳定模型计算成本高及现有求解器依赖CPU。为此,我们提出答案集网络(ASN),一种神经符号求解器。基于图神经网络(GNN),ASNs是一种可扩展的深度概率逻辑编程方法。具体地,我们将ASP转化为ASN,并展示如何利用GPU的批处理和并行能力高效求解。实验表明,ASNs在多个任务上优于现有基于CPU的神经符号系统。同时,我们基于ASN的特性实现两项贡献:首次将大型语言模型(LLM)通过DPPL进行微调,使用ASN引导逻辑训练;并实现无人机的“宪法导航”,即在不确定环境中,将公开航空法规编码为ASN以指导无人飞行器路径规划。

原文摘要 · Abstract (English)

Although Answer Set Programming (ASP) allows constraining neural-symbolic (NeSy) systems, its employment is hindered by the prohibitive costs of computing stable models and the CPU-bound nature of state-of-the-art solvers. To this end, we propose Answer Set Networks (ASN), a NeSy solver. Based on Graph Neural Networks (GNN), ASNs are a scalable approach to ASP-based Deep Probabilistic Logic Programming (DPPL). Specifically, we show how to translate ASPs into ASNs and demonstrate how ASNs can efficiently solve the encoded problem by leveraging GPU's batching and parallelization capabilities. Our experimental evaluations demonstrate that ASNs outperform state-of-the-art CPU-bound NeSy systems on multiple tasks. Simultaneously, we make the following two contributions based on the strengths of ASNs. Namely, we are the first to show the finetuning of Large Language Models (LLM) with DPPLs, employing ASNs to guide the training with logic. Further, we show the "constitutional navigation" of drones, i.e., encoding public aviation laws in an ASN for routing Unmanned Aerial Vehicles in uncertain environments.

神经符号图神经网络逻辑编程AI可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。