让大模型在信息不全时像人一样快慢思考,提升决策准确性。
NeSyFS: A Neuro-symbolic Fast-Slow Thinking Framework for LLM Agent under Partial Observability

- 用知识图谱表示信念状态,快思与慢思模块协同决策。
- 在三个基准上显著优于已有方法,尤其在信息不全场景表现突出。
- 适合需要推理与规划的复杂任务,如智能助手、自动科研等。
最近,大语言模型(LLMs)被广泛用于自省、检索增强生成和科学发现等自主代理应用中。在这些场景下,代理需基于有限观测而非完整环境状态进行决策,带来部分可观测性问题,包括信念状态推断、任务目标错位以及不确定性下的规划挑战。现有方法通常依赖完整或摘要的动作-观测历史,冗余信息可能误导决策。受人类认知启发,我们提出一种新型神经符号快慢思维框架(NeSyFS),统一应对部分可观测性带来的挑战。通过知识图谱(KG)表示信念状态,并为各个模块提供三元组上下文。快思维模块执行反应式动作,慢思维模块则依据扭曲序列蒙特卡洛(TSMC)算法结构进行不确定性感知规划。为缓解任务目标错位,引入反思模块,对快思维动作进行反思,并在反应式动作持续失败时切换至慢思维。在ALFWorld、Webshop和ScienceWorld三个代表性基准上的实验表明,该方法显著优于此前方法。
原文摘要 · Abstract (English)
Recently Large Language Models (LLMs) have been increasingly deployed as autonomous agents in applications such as self-reflection, retrieval-augmented generation, and scientific discovery. In these settings, agents must act based on limited observations rather than full environmental states, leading to partial observability. This introduces several key challenges: belief state inference, task objective misalignment, and planning under uncertainty. Prior approaches typically condition actions on full or summarized action-observation histories whose redundant and irrelevant information can mislead the decision making of LLM agent. Inspired by human cognition, we propose a novel neuro-symbolic fast-slow thinking (NeSyFS) framework for LLM agent, addressing the challenges introduced by partial observability in a unified approach. We use a knowledge graph (KG) to represent the belief state, providing triplets as context for every module of NeSyFS. The fast-thinking module performs reactive action, while slow-thinking conducts a new uncertainty-aware planning by following the high-level structure of twisted sequential Monte Carlo (TSMC) algorithm. To mitigate the misalignment of task objective, a reflection module is used to reflect fast-thinking actions, and also switches to the slow-thinking module whenever reactive actions repeatedly fail. Experiments on three representative benchmarks, i.e. ALFWorld, Webshop, and ScienceWorld, demonstrate significant advantages over previous methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。