用规则增强记忆协同,让大模型在复杂环境中更可靠地完成任务。
RPMS: Enhancing LLM-Based Embodied Planning through Rule-Augmented Memory Synergy
- 通过规则检索确保动作合法,用信念状态过滤记忆使用
- 在ALFWorld上单次成功率达59.7%(提升23.9个百分点)
- 适合需要精准动作控制的智能体任务研究者
LLM智能体在封闭世界具身环境中常因动作需满足严格先决条件(如位置、物品持有、容器状态)而失败,且失败反馈稀疏。我们识别出两种相互耦合的失败模式:(P1) 动作生成无效,(P2) 状态漂移,二者形成恶性循环。提出RPMS架构,通过结构化规则检索保障动作可行性,用轻量级信念状态控制记忆适用性,并以规则优先仲裁冲突。在ALFWorld(134个未见任务)上,使用Llama 3.1 8B时单次成功率达59.7%(较基线提升23.9个百分点),使用Claude Sonnet 4.5时达98.5%(提升11.9个百分点);其中规则检索单独贡献+14.9个百分点(统计显著),为主要因素。关键发现:情景记忆有条件有用——未经状态约束时会损害某些任务表现,但经当前状态过滤并受显式动作规则限制后,整体成为稳定正向增益。将RPMS应用于ScienceWorld(GPT-4)在所有消融条件下均取得一致提升(平均得分54.0 vs. ReAct基线44.9),证明核心机制在结构不同的环境中具有可迁移性。
原文摘要 · Abstract (English)
LLM agents often fail in closed-world embodied environments because actions must satisfy strict preconditions -- such as location, inventory, and container states -- and failure feedback is sparse. We identify two structurally coupled failure modes: (P1) invalid action generation and (P2) state drift, each amplifying the other in a degenerative cycle. We present RPMS, a conflict-managed architecture that enforces action feasibility via structured rule retrieval, gates memory applicability via a lightweight belief state, and resolves conflicts between the two sources via rules-first arbitration. On ALFWorld (134 unseen tasks), RPMS achieves 59.7% single-trial success with Llama 3.1 8B (+23.9 pp over baseline) and 98.5% with Claude Sonnet 4.5 (+11.9 pp); of the 8B gain, rule retrieval alone contributes +14.9 pp (statistically significant), making it the dominant factor. A key finding is that episodic memory is conditionally useful: it harms performance on some task types when used without grounding, but becomes a stable net positive once filtered by current state and constrained by explicit action rules. Adapting RPMS to ScienceWorld with GPT-4 yields consistent gains across all ablation conditions (avg. score 54.0 vs. 44.9 for the ReAct baseline), providing transfer evidence that the core mechanisms hold across structurally distinct environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。