用基础模型实现可泛化的神经符号学习,解决复杂推理的可靠性与可解释性难题。
The Road to Generalizable Neuro-Symbolic Learning Should be Paved with Foundation Models
- 将基础模型与符号程序结合,通过提示实现复杂推理
- 传统方法因计算、数据、程序限制难以泛化,而基础模型可克服此问题
- 适合追求可解释性与稳定性的复杂任务研究者
神经符号学习旨在应对神经网络在复杂推理任务中的挑战,兼具可解释性、可靠性与效率。传统方法需联合训练神经模型与符号程序,但受限于计算资源、数据量和程序设计,难以泛化。而纯神经基础模型虽通过提示达到顶尖性能,却常不可靠且缺乏可解释性。本文提出神经符号提示:将符号程序引入基础模型以支持复杂推理。文章指出传统方法在计算、数据、程序三方面存在三大陷阱,导致泛化困难。本文主张,基础模型能实现可泛化的神经符号解决方案,无需从零训练,从而重拾神经符号学习的初衷。
原文摘要 · Abstract (English)
Neuro-symbolic learning was proposed to address challenges with training neural networks for complex reasoning tasks with the added benefits of interpretability, reliability, and efficiency. Neuro-symbolic learning methods traditionally train neural models in conjunction with symbolic programs, but they face significant challenges that limit them to simplistic problems. On the other hand, purely-neural foundation models now reach state-of-the-art performance through prompting rather than training, but they are often unreliable and lack interpretability. Supplementing foundation models with symbolic programs, which we call neuro-symbolic prompting, provides a way to use these models for complex reasoning tasks. Doing so raises the question: What role does specialized model training as part of neuro-symbolic learning have in the age of foundation models? To explore this question, we highlight three pitfalls of traditional neuro-symbolic learning with respect to the compute, data, and programs leading to generalization problems. This position paper argues that foundation models enable generalizable neuro-symbolic solutions, offering a path towards achieving the original goals of neuro-symbolic learning without the downsides of training from scratch.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。