用图结构记忆增强大模型的长程任务规划能力
Embodied Task Planning via Graph-Informed Action Generation with Large Language Models
- 构建图中图记忆结构,用图神经网络编码环境状态
- 在三个基准上提升15%-37%成功率,且计算开销可控
- 适合需要长期规划的机器人任务,如复杂室内操作
尽管大语言模型具备强大的零样本推理能力,但将其部署为具身智能体仍面临长程规划的根本挑战。与开放文本生成不同,具身智能体需将高层意图分解为可执行子目标,并遵守动态环境约束。标准大模型规划器常因上下文窗口限制导致策略不连贯,或幻觉出违反环境规则的状态转移。本文提出GiG框架,采用图中图架构组织智能体记忆。通过图神经网络将环境状态编码为嵌入,并在经验记忆库中构建动作连接的执行轨迹图。该设计支持检索结构相似的历史先验,使当前决策能基于相关过往模式进行锚定。此外,引入有界前瞻模块,利用符号化转移逻辑实现基于事实的动作预测,增强规划能力。在Robotouille Synchronous、Robotouille Asynchronous和ALFWorld三个具身规划基准上评估,本方法相较现有最优基线,在Pass@1指标上分别提升22%、37%和15%,同时保持相当或更低的计算成本。
原文摘要 · Abstract (English)
While Large Language Models (LLMs) have demonstrated strong zero-shot reasoning capabilities, their deployment as embodied agents still faces fundamental challenges in long-horizon planning. Unlike open-ended text generation, embodied agents must decompose high-level intents into actionable sub-goals while adhering to the constraints of a dynamic environment. Standard LLM planners frequently fail to maintain strategy coherence over extended horizons due to context window limitations or hallucinate state transitions that violate environment constraints. We propose GiG, a planning framework that structures embodied agents' memory using a Graph-in-Graph architecture. Our approach employs a Graph Neural Network (GNN) to encode environmental states into embeddings, organizing these embeddings into action-connected execution trace graphs within an experience memory bank. GiG enables retrieval of structurally-similar priors, allowing agents to ground current decisions in relevant past structural patterns. Furthermore, we introduce a bounded lookahead module that leverages symbolic transition logic to enhance the agent's planning capabilities through grounded action projections. We evaluate our framework on three embodied planning benchmarks-Robotouille Synchronous, Robotouille Asynchronous, and ALFWorld. Our method outperforms state-of-the-art baselines, achieving Pass@1 performance gains of up to 22% on Robotouille Synchronous, 37% on Asynchronous, and 15% on ALFWorld while maintaining comparable or lower computational cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。