探索大模型如何融合符号逻辑推理,提升可靠性和准确性。
Proceedings of the First International Workshop on Next-Generation Language Models for Knowledge Representation and Reasoning (NeLaMKRR 2024)
- 对比语言模型与符号系统在知识推理上的能力差异。
- 尝试通过神经符号方法向大模型注入逻辑推理能力。
- 适合关注AI可靠性、可解释性的研究者和工程师。
推理是人类智能的核心,对批判性思维、负责任决策和解决复杂问题至关重要。传统上,人工智能依赖基于逻辑的知识表示来实现推理。然而,近年来以Transformer为基础的语言模型在自然语言处理上的突破,暗示其可能具备推理能力,尤其随着模型规模扩大和训练数据增加。尽管关于语言模型是否真正具备推理能力仍存在争议,但目前尚难明确界定其实际推理水平。本次研讨会旨在为来自不同学科或视角的研究者提供平台,探讨如何弥合基于Transformer的语言模型与基于逻辑的知识表示之间的推理鸿沟。具体目标包括:对比语言模型与知识表示方法的推理能力;通过神经符号等手段将逻辑式推理能力注入语言模型;形式化语言模型所执行的推理类型。该研究旨在揭示语言模型如何有效整合与利用知识与推理,从而提升其在精度与可靠性要求高的领域的应用价值。
原文摘要 · Abstract (English)
Reasoning is an essential component of human intelligence as it plays a fundamental role in our ability to think critically, support responsible decisions, and solve challenging problems. Traditionally, AI has addressed reasoning in the context of logic-based representations of knowledge. However, the recent leap forward in natural language processing, with the emergence of language models based on transformers, is hinting at the possibility that these models exhibit reasoning abilities, particularly as they grow in size and are trained on more data. Despite ongoing discussions about what reasoning is in language models, it is still not easy to pin down to what extent these models are actually capable of reasoning. The goal of this workshop is to create a platform for researchers from different disciplines and/or AI perspectives, to explore approaches and techniques with the aim to reconcile reasoning between language models using transformers and using logic-based representations. The specific objectives include analyzing the reasoning abilities of language models measured alongside KR methods, injecting KR-style reasoning abilities into language models (including by neuro-symbolic means), and formalizing the kind of reasoning language models carry out. This exploration aims to uncover how language models can effectively integrate and leverage knowledge and reasoning with it, thus improving their application and utility in areas where precision and reliability are a key requirement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。