用球形神经网络实现可靠逻辑推理,解决模型遗忘与错误传播问题。
An AI Monkey Gets Grapes for Sure -- Sphere Neural Networks for Reliable Decision-Making
- 将概念嵌入高维球面,用互补圆表示否定,构建可解释逻辑结构。
- 在16种三段论任务中达100%准确率,经典推理能力不退化。
- 适合需要高可靠性决策的场景,如医疗、金融自动化系统。
本文对比了三种神经推理方法:大语言模型推理、基于监督学习的推理和显式模型构建推理。大语言模型在简单决策上仍不可靠,难以像动物一样无需大量语料即可完成基本判断。通过析取三段论测试发现,监督学习推理不如显式建模可靠。具体而言,一个欧拉网络在经典三段论推理中达到100.00%准确率后,重训练以实现析取三段论推理时,其在原有任务上的性能骤降至6.25%,且推理能力仅限于模式层面。为此,本文提出球形神经网络(Sphere Neural Networks),将概念表示为n维球面中的圆形区域,利用互补圆表示否定运算,并通过剔除不满足逻辑一致性条件的圆形组合来实现可靠决策。实验表明,该模型可掌握16种三段论推理任务,包括严格的析取三段论,同时保持经典三段论的严谨性。结论是,显式模型构建是三种神经推理方法中最可靠的。
原文摘要 · Abstract (English)
This paper compares three methodological categories of neural reasoning: LLM reasoning, supervised learning-based reasoning, and explicit model-based reasoning. LLMs remain unreliable and struggle with simple decision-making that animals can master without extensive corpora training. Through disjunctive syllogistic reasoning testing, we show that reasoning via supervised learning is less appealing than reasoning via explicit model construction. Concretely, we show that an Euler Net trained to achieve 100.00% in classic syllogistic reasoning can be trained to reach 100.00% accuracy in disjunctive syllogistic reasoning. However, the retrained Euler Net suffers severely from catastrophic forgetting (its performance drops to 6.25% on already-learned classic syllogistic reasoning), and its reasoning competence is limited to the pattern level. We propose a new version of Sphere Neural Networks that embeds concepts as circles on the surface of an n-dimensional sphere. These Sphere Neural Networks enable the representation of the negation operator via complement circles and achieve reliable decision-making by filtering out illogical statements that form unsatisfiable circular configurations. We demonstrate that the Sphere Neural Network can master 16 syllogistic reasoning tasks, including rigorous disjunctive syllogistic reasoning, while preserving the rigour of classical syllogistic reasoning. We conclude that neural reasoning with explicit model construction is the most reliable among the three methodological categories of neural reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。