用大模型生成符号规划,让机器人听懂自然语言指令。
NSP: A Neuro-Symbolic Natural Language Navigational Planner
- 结合大模型与符号推理,将自然语言转为可执行路径规划
- 在1500个任务中90.1%路径有效,平均比现有方法短19-77%
- 适合需要可靠路径规划的智能机器人系统
能够解析自由格式自然语言指令的路径规划器有望自动化众多机器人应用。这类规划器简化用户交互,实现对复杂半自主系统的直观控制。尽管现有符号方法在正确性和效率上具有保证,却难以处理自由格式的自然语言输入;而基于预训练大语言模型(LLMs)的神经方法虽能处理自然语言输入,但缺乏性能保障。本文提出一种名为NSP的神经符号框架,用于从自然语言输入进行路径规划。该框架利用大模型的神经推理能力,首先构建环境的符号表示,其次生成符号路径规划算法。随后,通过在环境表示上执行该算法获得路径规划解。框架引入符号执行环境到神经生成过程的反馈机制,以自我修正语法错误并满足执行时间约束。我们在包含1500个路径规划问题的基准测试套件上评估该方法。实验结果表明,该神经符号方法生成了90.1%有效的路径,且平均长度比当前最先进的神经方法缩短19%-77%。
原文摘要 · Abstract (English)
Path planners that can interpret free-form natural language instructions hold promise to automate a wide range of robotics applications. These planners simplify user interactions and enable intuitive control over complex semi-autonomous systems. While existing symbolic approaches offer guarantees on the correctness and efficiency, they struggle to parse free-form natural language inputs. Conversely, neural approaches based on pre-trained Large Language Models (LLMs) can manage natural language inputs but lack performance guarantees. In this paper, we propose a neuro-symbolic framework for path planning from natural language inputs called NSP. The framework leverages the neural reasoning abilities of LLMs to i) craft symbolic representations of the environment and ii) a symbolic path planning algorithm. Next, a solution to the path planning problem is obtained by executing the algorithm on the environment representation. The framework uses a feedback loop from the symbolic execution environment to the neural generation process to self-correct syntax errors and satisfy execution time constraints. We evaluate our neuro-symbolic approach using a benchmark suite with 1500 path-planning problems. The experimental evaluation shows that our neuro-symbolic approach produces 90.1% valid paths that are on average 19-77% shorter than state-of-the-art neural approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。