让大模型的推理变成带不确定性的智能决策树,减少沟通开销。
From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agents
- 把大模型推理中的隐含假设转为结构化决策树,分节点和动作
- 在两个基准上提升成功率与效率,通信量几乎不变
- 适合需要低沟通、高信任的人机协作场景
在多智能体、部分可观测、去中心化的环境中,具身智能体需在隐藏物体和合作方意图不确定的情况下规划与行动。尽管大语言模型(LLM)已解决目标分解与在线适应等长期挑战,但不确定性仍依赖频繁通信,带来高昂的令牌与时间成本,尤其在有人类参与时易打断流程。本文提出PCE框架——规划-组合-评估,将LLM推理痕迹中隐含的碎片化假设转化为结构化决策树:内部节点表示环境假设,叶节点对应具体动作;每条路径通过场景可能性、目标收益与执行成本综合评分,实现无需密集通信的理性决策。在两个复杂多智能体基准(C-WAH与TDW-MAT)及三种不同LLM架构下,PCE在成功率与任务效率上持续优于以通信为核心的基线,同时保持相近的令牌消耗。消融实验表明,模型容量或推理深度的扩展收益在引入PCE后依然存在,且PCE在各类规模下均稳定提升基线表现,证实结构化不确定性处理可与两类扩展并行互补。用户研究进一步显示,人类合作者认为PCE生成的沟通模式更高效可信。这些结果确立了一条从大模型隐含假设到可靠不确定性感知规划的系统性路径。
原文摘要 · Abstract (English)
Embodied agents operating in multi-agent, partially observable, and decentralized environments must plan and act despite pervasive uncertainty about hidden objects and collaborators' intentions. Recent advances in applying Large Language Models (LLMs) to embodied agents have addressed many long-standing challenges, such as high-level goal decomposition and online adaptation. Yet, uncertainty is still primarily mitigated through frequent inter-agent communication. This incurs substantial token and time costs, and can disrupt established workflows, when human partners are involved. We introduce PCE, a Planner-Composer-Evaluator framework that converts the fragmented assumptions latent in LLM reasoning traces into a structured decision tree. Internal nodes encode environment assumptions and leaves map to actions; each path is then scored by scenario likelihood, goal-directed gain, and execution cost to guide rational action selection without heavy communication. Across two challenging multi-agent benchmarks (C-WAH and TDW-MAT) and three diverse LLM backbones, PCE consistently outperforms communication-centric baselines in success rate and task efficiency while showing comparable token usage. Ablation results indicate that the performance gains obtained by scaling model capacity or reasoning depth persist even when PCE is applied, while PCE consistently raises the baseline across both capacity and reasoning-depth scales, confirming that structured uncertainty handling complements both forms of scaling. A user study further demonstrates that PCE produces communication patterns that human partners perceive as more efficient and trustworthy. Together, these results establish a principled route for turning latent LLM assumptions into reliable strategies for uncertainty-aware planning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。