让大模型学会推断行为背后的隐藏意图,提升多智能体协作能力。
Inferring Latent Intentions: Attributional Natural Language Inference in LLM Agents
- 引入社会心理学原理,构建可推断意图的推理框架
- 神经符号模型在游戏测试中胜率高达17.08%,表现最优
- 适合研究多智能体系统、高级推理与可信AI的读者
Attributional inference(归因推理)——即预测观察到行为背后的潜在意图——是大型语言模型(LLMs)在多智能体环境中运行时的关键但未被充分探索的能力。传统自然语言推理(NLI)无法捕捉复杂交互系统所需的细微意图驱动推理。为此,我们提出归因式自然语言推理(Att-NLI),该框架融合社会心理学原则,评估智能体进行溯因式意图推断(生成潜在意图假设)和后续演绎验证(得出有效逻辑结论)的能力。我们通过文本游戏Undercover-V实现Att-NLI,对比三种不同推理能力与外部工具访问权限的LLM智能体:仅使用演绎推理的标准NLI智能体、采用溯因-演绎推理的Att-NLI智能体,以及结合外部定理证明器进行溯因-演绎推理的神经符号型Att-NLI智能体。大量实验显示清晰的能力层级,神经符号智能体始终领先,平均胜率达到17.08%。结果表明,Att-NLI能有效促进具备复杂推理能力的智能体发展,同时凸显神经符号人工智能在构建理性多智能体系统中的潜力。
原文摘要 · Abstract (English)
Attributional inference, the ability to predict latent intentions behind observed actions, is a critical yet underexplored capability for large language models (LLMs) operating in multi-agent environments. Traditional natural language inference (NLI), in fact, fails to capture the nuanced, intention-driven reasoning essential for complex interactive systems. To address this gap, we introduce Attributional NLI (Att-NLI), a framework that extends NLI with principles from social psychology to assess an agent's capacity for abductive intentional inference (generating hypotheses about latent intentions), and subsequent deductive verification (drawing valid logical conclusions). We instantiate Att-NLI via a textual game, Undercover-V, experimenting with three types of LLM agents with varying reasoning capabilities and access to external tools: a standard NLI agent using only deductive inference, an Att-NLI agent employing abductive-deductive inference, and a neuro-symbolic Att-NLI agent performing abductive-deductive inference with external theorem provers. Extensive experiments demonstrate a clear hierarchy of attributional inference capabilities, with neuro-symbolic agents consistently outperforming others, achieving an average win rate of 17.08%. Our results underscore the role that Att-NLI can play in developing agents with sophisticated reasoning capabilities, highlighting, at the same time, the potential impact of neuro-symbolic AI in building rational LLM agents acting in multi-agent environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。