用双记忆机制分离目标进展与执行可行性,提升长周期智能体表现
Aligning Progress and Feasibility: A Neuro-Symbolic Dual Memory Framework for Long-Horizon LLM Agents
- 分设神经网络进度记忆与符号逻辑可行性记忆,分别处理语义规划和严格验证
- 在三个基准上显著优于基线,无效动作率下降超40%,轨迹长度减少30%以上
- 适合需要长期规划且对安全性和可靠性要求高的智能体系统开发者
大型语言模型在长周期决策任务(如具身操作和网页交互)中展现出巨大潜力,但常陷入无尽试错循环或偏离目标。我们将其归因于两大根本性错误:全局进展漂移与局部可行性违反。现有方法多采用单一范式同时处理二者,但两者本质不同:前者依赖模糊的语义规划,后者需严格的逻辑约束与状态验证。为此,我们提出神经符号双记忆框架,显式分离语义进展引导与逻辑可行性验证。推理时同步调用两种记忆机制:神经进度记忆从成功轨迹中提取语义蓝图以指导全局任务推进;符号可行性记忆则通过从失败转移中合成的可执行Python验证函数,进行严格逻辑校验。实验表明,该方法在ALFWorld、WebShop和TextCraft上显著优于现有基线,无效动作率降低超40%,平均轨迹长度减少30%以上。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated strong potential in long-horizon decision-making tasks, such as embodied manipulation and web interaction. However, agents frequently struggle with endless trial-and-error loops or deviate from the main objective in complex environments. We attribute these failures to two fundamental errors: global Progress Drift and local Feasibility Violation. Existing methods typically attempt to address both issues simultaneously using a single paradigm. However, these two challenges are fundamentally distinct: the former relies on fuzzy semantic planning, while the latter demands strict logical constraints and state validation. The inherent limitations of such a single-paradigm approach pose a fundamental challenge for existing models in handling long-horizon tasks. Motivated by this insight, we propose a Neuro-Symbolic Dual Memory Framework that explicitly decouples semantic progress guidance from logical feasibility verification. Specifically, during the inference phase, the framework invokes both memory mechanisms synchronously: on one hand, a neural-network-based Progress Memory extracts semantic blueprints from successful trajectories to guide global task advancement; on the other hand, a symbolic-logic-based Feasibility Memory utilizes executable Python verification functions synthesized from failed transitions to perform strict logical validation. Experiments demonstrate that this method significantly outperforms existing competitive baselines on ALFWorld, WebShop, and TextCraft, while drastically reducing the invalid action rate and average trajectory length.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。