用符号验证+环境交互提升代码化策略的可靠性。
Towards Reliable Code-as-Policies: A Neuro-Symbolic Framework for Embodied Task Planning
- 结合符号验证与环境交互生成代码,增强对动态环境的适应性。
- 在RLBench上任务成功率提升46.2%,动作可执行率达86.8%以上。
- 适合需要高可靠性的机器人任务规划场景,尤其动态/部分可观测环境。
大型语言模型(LLMs)在生成具身智能体(如机器人)的任务规划与控制代码方面取得进展,展现出基于代码的策略潜力。然而,这类方法在动态或部分可观测环境中常因缺乏环境对齐,导致代码生成错误或不完整,进而影响任务成功率。本文提出一种神经符号式具身任务规划框架,在代码生成过程中引入显式的符号验证与交互式验证机制。在验证阶段,框架生成探索性代码,主动与环境交互以获取缺失观测,同时保留任务相关状态。该集成过程提升了代码的环境对齐性,显著增强了复杂环境中的任务可靠性与成功率。我们在RLBench及真实场景中评估了该框架,实验结果表明其相比Code-as-Policies基线任务成功率提升46.2%,任务相关动作可执行率超过86.8%,有效提升了动态环境下的任务规划可靠性。
原文摘要 · Abstract (English)
Recent advances in large language models (LLMs) have enabled the automatic generation of executable code for task planning and control in embodied agents such as robots, demonstrating the potential of LLM-based embodied intelligence. However, these LLM-based code-as-policies approaches often suffer from limited environmental grounding, particularly in dynamic or partially observable settings, leading to suboptimal task success rates due to incorrect or incomplete code generation. In this work, we propose a neuro-symbolic embodied task planning framework that incorporates explicit symbolic verification and interactive validation processes during code generation. In the validation phase, the framework generates exploratory code that actively interacts with the environment to acquire missing observations while preserving task-relevant states. This integrated process enhances the grounding of generated code, resulting in improved task reliability and success rates in complex environments. We evaluate our framework on RLBench and in real-world settings across dynamic, partially observable scenarios. Experimental results demonstrate that our framework improves task success rates by 46.2% over Code-as-Policies baselines and attains over 86.8% executability of task-relevant actions, thereby enhancing the reliability of task planning in dynamic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。